Jun 02 18:39:48.328047 ip-10-0-128-123 systemd[1]: Starting Kubernetes Kubelet... Jun 02 18:39:48.849422 ip-10-0-128-123 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:48.850138 ip-10-0-128-123 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 18:39:48.850138 ip-10-0-128-123 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:48.850138 ip-10-0-128-123 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 18:39:48.850138 ip-10-0-128-123 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:48.851585 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.851494 2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 18:39:48.854793 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854777 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:48.854793 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854793 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854798 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854801 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854804 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854807 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854811 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854814 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854816 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854819 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854822 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854824 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854827 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854829 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854832 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854834 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854836 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854839 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854841 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854850 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:48.854861 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854855 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854857 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854860 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854869 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854872 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854875 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854878 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854880 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854883 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854885 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854888 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854890 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854892 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854895 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854897 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854900 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854902 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854905 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854907 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854910 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:48.855321 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854912 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854915 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854917 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854920 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854922 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854925 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854927 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854930 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854932 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854935 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854939 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854942 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854945 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854948 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854952 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854955 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854958 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854961 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854963 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854966 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:48.855893 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854968 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854971 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854973 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854976 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854978 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854981 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854983 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854986 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854988 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854991 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854993 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854996 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.854998 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855000 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855003 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855006 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855009 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855011 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855015 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855017 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:48.856378 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855020 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855022 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855025 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855027 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855030 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855033 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855443 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855448 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855451 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855453 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855456 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855459 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855462 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855465 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855467 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855470 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855472 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855475 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855477 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855479 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:48.856876 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855482 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855485 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855487 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855490 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855492 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855495 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855498 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855503 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855506 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855508 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855510 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855513 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855515 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855518 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855520 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855523 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855525 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855528 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855531 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:48.857350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855534 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855537 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855539 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855542 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855544 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855547 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855549 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855552 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855554 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855559 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855561 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855563 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855566 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855568 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855571 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855575 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855579 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855582 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855585 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855587 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:48.857827 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855590 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855593 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855596 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855598 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855601 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855603 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855605 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855609 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855611 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855614 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855617 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855619 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855622 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855624 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855627 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855629 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855632 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855634 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855636 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855639 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:48.858317 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855641 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855644 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855646 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855650 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855653 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855658 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855661 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855663 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855666 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855668 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855671 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.855673 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855762 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855772 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855781 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855787 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855793 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855798 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855803 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855808 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 18:39:48.858822 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855811 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855814 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855818 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855822 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855825 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855828 2564 flags.go:64] FLAG: --cgroup-root="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855831 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855834 2564 flags.go:64] FLAG: --client-ca-file="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855836 2564 flags.go:64] FLAG: --cloud-config="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855839 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855842 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855848 2564 flags.go:64] FLAG: --cluster-domain="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855850 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855854 2564 flags.go:64] FLAG: --config-dir="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855856 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855860 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855864 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855867 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855871 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855874 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855877 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855880 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855883 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855886 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855888 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 18:39:48.859336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855892 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855902 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855906 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855908 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855911 2564 flags.go:64] FLAG: --enable-server="true" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855914 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855918 2564 flags.go:64] FLAG: --event-burst="100" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855921 2564 flags.go:64] FLAG: --event-qps="50" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855925 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855928 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855931 2564 flags.go:64] FLAG: --eviction-hard="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855935 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855938 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855941 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855944 2564 flags.go:64] FLAG: --eviction-soft="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855947 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855950 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855953 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855956 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855958 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855961 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855964 2564 flags.go:64] FLAG: --feature-gates="" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855968 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855971 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855974 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 18:39:48.859974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855977 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855980 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855983 2564 flags.go:64] FLAG: --help="false" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855986 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-123.ec2.internal" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855989 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855992 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855995 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.855998 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856001 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856005 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856007 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856010 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856013 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856015 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856018 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856021 2564 flags.go:64] FLAG: --kube-reserved="" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856025 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856027 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856030 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856033 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856036 2564 flags.go:64] FLAG: --lock-file="" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856039 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856042 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856045 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 18:39:48.860565 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856050 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856052 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856055 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856058 2564 flags.go:64] FLAG: --logging-format="text" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856061 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856064 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856067 2564 flags.go:64] FLAG: --manifest-url="" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856075 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856079 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856082 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856086 2564 flags.go:64] FLAG: --max-pods="110" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856089 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856092 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856094 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856097 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856100 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856103 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856106 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856114 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856117 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856120 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856123 2564 flags.go:64] FLAG: --pod-cidr="" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856126 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 18:39:48.861173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856132 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856135 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856138 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856141 2564 flags.go:64] FLAG: --port="10250" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856144 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856146 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e4ea456acca56522" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856150 2564 flags.go:64] FLAG: --qos-reserved="" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856153 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856155 2564 flags.go:64] FLAG: --register-node="true" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856158 2564 flags.go:64] FLAG: --register-schedulable="true" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856161 2564 flags.go:64] FLAG: --register-with-taints="" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856164 2564 flags.go:64] FLAG: --registry-burst="10" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856167 2564 flags.go:64] FLAG: --registry-qps="5" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856170 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856173 2564 flags.go:64] FLAG: --reserved-memory="" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856177 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856179 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856184 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856187 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856190 2564 flags.go:64] FLAG: --runonce="false" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856193 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856195 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856198 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856201 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856204 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856207 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 18:39:48.861786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856210 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856214 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856217 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856220 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856223 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856226 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856229 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856232 2564 flags.go:64] FLAG: --system-cgroups="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856234 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856240 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856243 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856245 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856250 2564 flags.go:64] FLAG: --tls-min-version="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856252 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856255 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856258 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856260 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856263 2564 flags.go:64] FLAG: --v="2" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856268 2564 flags.go:64] FLAG: --version="false" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856272 2564 flags.go:64] FLAG: --vmodule="" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856276 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.856279 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856369 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856375 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:48.862437 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856378 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856382 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856385 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856388 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856391 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856394 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856397 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856399 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856402 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856406 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856408 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856412 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856415 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856418 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856422 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856425 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856427 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856430 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856432 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856435 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:48.863054 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856437 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856439 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856442 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856444 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856447 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856449 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856451 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856454 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856457 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856460 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856462 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856466 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856468 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856471 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856473 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856476 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856478 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856481 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856483 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856486 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:48.863594 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856488 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856491 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856493 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856495 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856499 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856501 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856505 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856508 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856511 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856515 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856517 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856520 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856522 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856525 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856527 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856530 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856532 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856534 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856537 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856539 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:48.864144 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856541 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856544 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856546 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856550 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856552 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856555 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856557 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856560 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856563 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856565 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856568 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856570 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856572 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856575 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856578 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856580 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856583 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856586 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856590 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856592 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:48.864731 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856594 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:48.865247 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856597 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:48.865247 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856599 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:48.865247 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.856602 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:48.865247 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.857493 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:48.867423 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.867402 2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 18:39:48.867462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.867425 2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 18:39:48.867492 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867479 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:48.867492 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867485 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:48.867492 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867488 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:48.867492 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867491 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:48.867492 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867495 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867497 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867501 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867503 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867506 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867509 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867511 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867513 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867516 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867518 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867521 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867523 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867526 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867528 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867531 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867533 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867536 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867538 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867542 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867544 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:48.867619 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867547 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867549 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867552 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867555 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867557 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867560 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867562 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867565 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867567 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867570 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867572 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867575 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867577 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867580 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867583 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867586 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867588 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867591 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867593 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:48.868139 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867596 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867598 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867600 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867603 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867605 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867608 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867610 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867613 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867615 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867618 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867621 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867623 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867626 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867629 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867632 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867634 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867637 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867639 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867642 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867645 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:48.868608 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867647 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867650 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867652 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867655 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867658 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867660 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867662 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867667 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867671 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867674 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867676 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867681 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867685 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867688 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867691 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867694 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867696 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867699 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867702 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:48.869135 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867705 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867708 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867710 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867713 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.867718 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867842 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867849 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867852 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867854 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867857 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867860 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867863 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867866 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867868 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867871 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867873 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:48.869590 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867876 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867878 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867881 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867883 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867887 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867891 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867894 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867897 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867900 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867903 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867906 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867909 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867911 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867914 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867916 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867919 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867921 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867924 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867926 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867928 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:48.870001 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867931 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867934 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867936 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867939 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867942 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867944 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867947 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867950 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867952 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867955 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867957 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867960 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867962 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867965 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867967 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867969 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867972 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867975 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867977 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867980 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:48.870491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867982 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867985 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867987 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867989 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867992 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867995 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867997 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.867999 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868002 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868004 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868007 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868009 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868012 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868014 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868017 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868019 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868022 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868025 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868027 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:48.871031 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868030 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868032 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868035 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868037 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868039 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868042 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868045 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868048 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868051 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868053 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868056 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868059 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868061 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868064 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868066 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:48.871491 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:48.868069 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:48.871867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.868074 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:48.871867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.868958 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 18:39:48.873638 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.873623 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 18:39:48.874783 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.874770 2564 server.go:1019] "Starting client certificate rotation" Jun 02 18:39:48.874889 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.874873 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:48.874920 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.874914 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:48.903354 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.903330 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:48.905203 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.905182 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:48.931452 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.931412 2564 log.go:25] "Validated CRI v1 runtime API" Jun 02 18:39:48.938412 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.938393 2564 log.go:25] "Validated CRI v1 image API" Jun 02 18:39:48.939750 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.939718 2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 18:39:48.942497 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.942470 2564 fs.go:135] Filesystem UUIDs: map[0b7ea171-65b2-45af-b6a9-ff25d6453ba7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e51a94a9-2109-4853-a524-dec7c5ba67f4:/dev/nvme0n1p4] Jun 02 18:39:48.942572 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.942496 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 18:39:48.946943 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.946825 2564 manager.go:217] Machine: {Timestamp:2026-06-02 18:39:48.946267768 +0000 UTC m=+0.482096588 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090303 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21786b9a6ea330d18e02b1c112bf0d SystemUUID:ec21786b-9a6e-a330-d18e-02b1c112bf0d BootID:1d71de25-3fa0-4499-94c6-e1ed4291e094 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:ff:e3:16:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:ff:e3:16:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:29:bf:21:ec:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 18:39:48.947042 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.947027 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:48.947532 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.947521 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 18:39:48.947628 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.947615 2564 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 18:39:48.951944 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.951919 2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 18:39:48.952119 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.951947 2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 18:39:48.952170 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.952127 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 18:39:48.952170 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.952136 2564 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 18:39:48.952170 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.952144 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:48.953330 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.953319 2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:48.955072 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.955062 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:48.955192 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.955183 2564 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 18:39:48.958256 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.958244 2564 kubelet.go:491] "Attempting to sync node with API server" Jun 02 18:39:48.958295 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.958265 2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 18:39:48.958295 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.958279 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 18:39:48.958295 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.958289 2564 kubelet.go:397] "Adding apiserver pod source" Jun 02 18:39:48.958408 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.958300 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 18:39:48.959546 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.959534 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:48.959608 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.959555 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:48.967260 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.967205 2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 18:39:48.967260 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.967222 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlt4g" Jun 02 18:39:48.970050 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.970032 2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 18:39:48.970145 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.970062 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlt4g" Jun 02 18:39:48.972731 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:48.972678 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 18:39:48.972731 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:48.972720 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 18:39:48.972873 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972863 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972877 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972883 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972889 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972897 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972903 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972911 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 18:39:48.972917 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972919 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 18:39:48.973098 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972927 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 18:39:48.973098 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972934 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 18:39:48.973098 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972942 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 18:39:48.973098 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.972948 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 18:39:48.973918 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.973906 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 18:39:48.973918 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.973918 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 18:39:48.977187 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.977173 2564 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 18:39:48.977250 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.977212 2564 server.go:1295] "Started kubelet" Jun 02 18:39:48.977429 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.977404 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 18:39:48.977664 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.977634 2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 18:39:48.977695 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.977681 2564 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 18:39:48.977940 ip-10-0-128-123 systemd[1]: Started Kubernetes Kubelet. Jun 02 18:39:48.978445 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.978438 2564 server.go:317] "Adding debug handlers to kubelet server" Jun 02 18:39:48.979319 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.979302 2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 18:39:48.986223 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.986205 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:48.986929 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.986906 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 18:39:48.987028 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987016 2564 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 18:39:48.987085 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987033 2564 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 18:39:48.987194 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987173 2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 18:39:48.987276 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987248 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 02 18:39:48.987276 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987257 2564 reconciler.go:26] "Reconciler: start to sync state" Jun 02 18:39:48.987689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987667 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 18:39:48.987801 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987690 2564 factory.go:55] Registering systemd factory Jun 02 18:39:48.987801 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.987752 2564 factory.go:223] Registration of the systemd container factory successfully Jun 02 18:39:48.987801 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:48.987761 2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 18:39:48.988045 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:48.988025 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:48.988135 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.988100 2564 factory.go:153] Registering CRI-O factory Jun 02 18:39:48.988135 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.988111 2564 factory.go:223] Registration of the crio container factory successfully Jun 02 18:39:48.988135 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.988125 2564 factory.go:103] Registering Raw factory Jun 02 18:39:48.988289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.988138 2564 manager.go:1196] Started watching for new ooms in manager Jun 02 18:39:48.988462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.988447 2564 manager.go:319] Starting recovery of all containers Jun 02 18:39:48.990285 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.990268 2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:48.991804 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:48.991778 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-123.ec2.internal\" not found" node="ip-10-0-128-123.ec2.internal" Jun 02 18:39:48.993167 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.992995 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-123.ec2.internal" not found Jun 02 18:39:48.998390 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:48.998374 2564 manager.go:324] Recovery completed Jun 02 18:39:49.003264 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.003247 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.005317 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005304 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.005375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005332 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.005375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005342 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.005820 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005808 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 18:39:49.005820 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005819 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 18:39:49.005906 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.005839 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:49.009578 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.009562 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-123.ec2.internal" not found Jun 02 18:39:49.009785 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.009774 2564 policy_none.go:49] "None policy: Start" Jun 02 18:39:49.009821 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.009792 2564 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 18:39:49.009821 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.009802 2564 state_mem.go:35] "Initializing new in-memory state store" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.052437 2564 manager.go:341] "Starting Device Plugin manager" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.052482 2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.052494 2564 server.go:85] "Starting device plugin registration server" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.052804 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.052816 2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.052918 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.053013 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.053022 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.053531 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 18:39:49.063120 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.053565 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.066451 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.066428 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-123.ec2.internal" not found Jun 02 18:39:49.077809 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.077769 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 18:39:49.079332 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.079313 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 18:39:49.079415 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.079337 2564 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 18:39:49.079415 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.079366 2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 18:39:49.079415 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.079375 2564 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 18:39:49.079753 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.079423 2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 18:39:49.082227 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.082209 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.153269 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.153167 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.154366 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.154348 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.154480 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.154386 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.154480 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.154402 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.154480 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.154434 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.161782 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.161761 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.161865 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.161787 2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-123.ec2.internal\": node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.179643 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.179614 2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal"] Jun 02 18:39:49.179786 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.179687 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.180602 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.180585 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.180676 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.180613 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.180676 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.180625 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.181682 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.181669 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.181864 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.181849 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.181912 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.181881 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.182340 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.182324 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182338 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182370 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182385 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182386 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182408 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.182422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.182418 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.183289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.183277 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.183328 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.183299 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:49.183975 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.183956 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:49.184061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.183982 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:49.184061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.183992 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:49.188016 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.187921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ee351bb55ad6be954235ac6b9f987-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"131ee351bb55ad6be954235ac6b9f987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.188016 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.187956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.188016 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.187986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.208530 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.208502 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-123.ec2.internal\" not found" node="ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.213179 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.213162 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-123.ec2.internal\" not found" node="ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.282671 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.282638 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.288668 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288648 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.288783 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288680 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.288783 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288708 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ee351bb55ad6be954235ac6b9f987-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"131ee351bb55ad6be954235ac6b9f987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.288783 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288772 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.288923 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ee351bb55ad6be954235ac6b9f987-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"131ee351bb55ad6be954235ac6b9f987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.288923 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.288842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/994b7340992241a93e28eb8a5fde6ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"994b7340992241a93e28eb8a5fde6ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.383402 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.383360 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.484206 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.484129 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.510568 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.510543 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.516010 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.515992 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.584606 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.584567 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.685086 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.685047 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.785635 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.785548 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 02 18:39:49.846168 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.846138 2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.874791 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.874762 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 18:39:49.875474 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.874899 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:49.875474 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.874938 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:49.875474 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.874934 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:49.887770 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.887726 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.904752 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.904712 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:49.906295 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.906281 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 02 18:39:49.915532 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.915514 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:49.919142 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.919120 2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.959482 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.959458 2564 apiserver.go:52] "Watching apiserver" Jun 02 18:39:49.970825 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.970804 2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 18:39:49.971111 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.971088 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b","openshift-dns/node-resolver-jsg4n","openshift-image-registry/node-ca-4dvvc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal","openshift-multus/network-metrics-daemon-jq5kp","openshift-ovn-kubernetes/ovnkube-node-bzl2v","openshift-cluster-node-tuning-operator/tuned-cmgrr","openshift-multus/multus-additional-cni-plugins-cpgk4","openshift-multus/multus-db4bd","openshift-network-diagnostics/network-check-target-7tg4q","openshift-network-operator/iptables-alerter-z6fqw","kube-system/konnectivity-agent-kdth9","kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal"] Jun 02 18:39:49.972401 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.972378 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:34:48 +0000 UTC" deadline="2027-12-19 12:58:39.170979994 +0000 UTC" Jun 02 18:39:49.972401 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.972400 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13554h18m49.198582354s" Jun 02 18:39:49.975730 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.975709 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.978337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978318 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:49.978658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978444 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:49.978658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978494 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 18:39:49.978658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978498 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.978658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978563 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.978658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.978507 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84vkv\"" Jun 02 18:39:49.980332 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.980312 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:49.980418 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.980381 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:39:49.981049 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981019 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.981204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981100 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.981204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981100 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-frbnd\"" Jun 02 18:39:49.981375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981341 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.981375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981375 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b5jjj\"" Jun 02 18:39:49.981473 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981357 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 18:39:49.981473 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.981360 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.982442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.982424 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.984292 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.984272 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.985040 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985020 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 18:39:49.985149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985031 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 18:39:49.985149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985072 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 18:39:49.985149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985098 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-phwbv\"" Jun 02 18:39:49.985149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985025 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 18:39:49.985149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985031 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.985357 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.985203 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.986293 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.986279 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.986422 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.986408 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:49.986903 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.986884 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9l96b\"" Jun 02 18:39:49.986903 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.986895 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.987050 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.986920 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.988246 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.988230 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.988657 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.988639 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 18:39:49.988892 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.988879 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.989161 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.989143 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 18:39:49.989267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.989213 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.989267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.989253 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 18:39:49.989374 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.989326 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rkz6\"" Jun 02 18:39:49.990256 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.990237 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:49.990361 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:49.990309 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:39:49.990905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.990878 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d4cdr\"" Jun 02 18:39:49.990999 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.990923 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 18:39:49.992602 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.992583 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:49.992927 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.992906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-kubelet\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.993007 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.992954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:49.993046 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993046 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-env-overrides\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993116 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-sys\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.993116 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-bin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.993173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.993205 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-kubelet\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993254 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-netns\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993254 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-bin\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993345 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-tuned\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.993345 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-registration-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.993345 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-host\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.993483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcg6\" (UniqueName: \"kubernetes.io/projected/1622cd0a-f809-4ad4-928a-1c05af2b04c7-kube-api-access-2lcg6\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.993483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-device-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.993483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993625 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cnibin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.993625 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-conf-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.993625 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.993837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-modprobe-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.993837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-multus\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.993837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-slash\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-log-socket\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.993837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-netd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.994071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-script-lib\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.994071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-var-lib-kubelet\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.994071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.994071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.993999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-node-log\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.994071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovn-node-metrics-cert\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.994289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.994289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-ovn\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.994289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-tmp\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.994289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef36ec2d-05d8-4c25-b086-d4d248941fa1-serviceca\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:49.994485 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-kubernetes\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.994485 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.994485 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-system-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.994849 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-socket-dir-parent\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.994958 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-netns\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.994958 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckcv\" (UniqueName: \"kubernetes.io/projected/6136ed07-28f6-428f-a671-9c65e8a8343b-kube-api-access-6ckcv\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.994958 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8qrm\" (UniqueName: \"kubernetes.io/projected/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-kube-api-access-t8qrm\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:49.994958 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994956 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.994955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-systemd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-cnibin\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-socket-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-sys-fs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22ddbfe5-c169-451c-b9ca-6425ea01c22a-hosts-file\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:49.995299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef36ec2d-05d8-4c25-b086-d4d248941fa1-host\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:49.995558 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-var-lib-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.995558 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-conf\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.995558 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-hostroot\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.995558 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-daemon-config\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.995779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-systemd-units\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.995779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysconfig\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.995779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-lib-modules\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.995779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cni-binary-copy\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.995779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-k8s-cni-cncf-io\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.996035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-multus-certs\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.996035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5b58\" (UniqueName: \"kubernetes.io/projected/22ddbfe5-c169-451c-b9ca-6425ea01c22a-kube-api-access-v5b58\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:49.996035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlpc7\" (UniqueName: \"kubernetes.io/projected/ef36ec2d-05d8-4c25-b086-d4d248941fa1-kube-api-access-mlpc7\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:49.996035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.995989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-systemd\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.996035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-run\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-config\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996165 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cs5xf\"" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-etc-kubernetes\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-system-cni-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996232 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 18:39:49.996297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ddbfe5-c169-451c-b9ca-6425ea01c22a-tmp-dir\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-etc-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjxbx\" (UniqueName: \"kubernetes.io/projected/cca77f4f-c89f-4c40-80c8-fc99853e8f87-kube-api-access-jjxbx\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-os-release\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ldk\" (UniqueName: \"kubernetes.io/projected/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-kube-api-access-d5ldk\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-os-release\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj7bs\" (UniqueName: \"kubernetes.io/projected/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kube-api-access-cj7bs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:49.996641 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996621 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.997009 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.996682 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.997559 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.997521 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m28xb\"" Jun 02 18:39:49.997892 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.997877 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 18:39:49.997969 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.997911 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 18:39:49.999032 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:49.999012 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:50.020014 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.019991 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzk5n" Jun 02 18:39:50.028447 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.028425 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzk5n" Jun 02 18:39:50.088289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.088264 2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 18:39:50.096851 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096824 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjxbx\" (UniqueName: \"kubernetes.io/projected/cca77f4f-c89f-4c40-80c8-fc99853e8f87-kube-api-access-jjxbx\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.096952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096856 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-os-release\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.096952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096875 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ldk\" (UniqueName: \"kubernetes.io/projected/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-kube-api-access-d5ldk\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.096952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096903 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-os-release\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-os-release\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096973 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj7bs\" (UniqueName: \"kubernetes.io/projected/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kube-api-access-cj7bs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.096971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-os-release\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097067 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-kubelet\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.097106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097095 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097121 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097125 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-kubelet\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097144 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-env-overrides\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097172 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-sys\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097199 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-bin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097210 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097226 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.097243 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097273 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-kubelet\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-bin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-sys\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097297 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-netns\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-kubelet\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-run-netns\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.097400 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.097394 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.597322129 +0000 UTC m=+2.133150931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv49x\" (UniqueName: \"kubernetes.io/projected/7007fb74-8c1f-4a3f-b714-4365c1b239ae-kube-api-access-qv49x\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097478 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-bin\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097506 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-tuned\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-bin\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097536 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-registration-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097576 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-host\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-registration-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097604 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcg6\" (UniqueName: \"kubernetes.io/projected/1622cd0a-f809-4ad4-928a-1c05af2b04c7-kube-api-access-2lcg6\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-host\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097631 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-device-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7007fb74-8c1f-4a3f-b714-4365c1b239ae-iptables-alerter-script\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-env-overrides\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097698 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-device-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097724 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cnibin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097772 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-conf-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098106 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097784 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097796 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cnibin\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b70537-26d2-4c9c-b096-9091685db56e-agent-certs\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097867 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-conf-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097871 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-modprobe-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097903 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-multus\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097928 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-slash\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097952 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-log-socket\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097962 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097786 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-var-lib-cni-multus\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-log-socket\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098007 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-slash\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.097977 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-netd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-host-cni-netd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.098941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-modprobe-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098054 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-script-lib\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098119 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-var-lib-kubelet\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098144 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098173 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-node-log\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098205 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovn-node-metrics-cert\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-var-lib-kubelet\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098238 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-node-log\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098253 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098283 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098310 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-ovn\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098334 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-tmp\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098357 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef36ec2d-05d8-4c25-b086-d4d248941fa1-serviceca\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098380 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-kubernetes\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098402 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098428 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-system-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-kubernetes\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098453 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-socket-dir-parent\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.099706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098493 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-netns\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-socket-dir-parent\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098521 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckcv\" (UniqueName: \"kubernetes.io/projected/6136ed07-28f6-428f-a671-9c65e8a8343b-kube-api-access-6ckcv\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-script-lib\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7007fb74-8c1f-4a3f-b714-4365c1b239ae-host-slash\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-d\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-ovn\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-netns\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-system-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098600 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8qrm\" (UniqueName: \"kubernetes.io/projected/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-kube-api-access-t8qrm\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098689 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-systemd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098718 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098762 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-cnibin\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098786 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-socket-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098811 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-sys-fs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098830 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-cni-dir\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098834 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22ddbfe5-c169-451c-b9ca-6425ea01c22a-hosts-file\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098876 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef36ec2d-05d8-4c25-b086-d4d248941fa1-host\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.100484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22ddbfe5-c169-451c-b9ca-6425ea01c22a-hosts-file\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-systemd\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098903 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-var-lib-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef36ec2d-05d8-4c25-b086-d4d248941fa1-host\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098951 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-conf\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098979 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-hostroot\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef36ec2d-05d8-4c25-b086-d4d248941fa1-serviceca\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099000 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-sys-fs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.098921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-cnibin\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b28e8c65-fd48-4b8c-8e69-441fe99074a7-socket-dir\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099005 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-daemon-config\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099051 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-systemd-units\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099056 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-var-lib-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-hostroot\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099083 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysconfig\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099103 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-systemd-units\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099107 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-lib-modules\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099136 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cni-binary-copy\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.101148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysctl-conf\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099159 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-k8s-cni-cncf-io\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-sysconfig\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-k8s-cni-cncf-io\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099197 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-lib-modules\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099215 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-multus-certs\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099244 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5b58\" (UniqueName: \"kubernetes.io/projected/22ddbfe5-c169-451c-b9ca-6425ea01c22a-kube-api-access-v5b58\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b70537-26d2-4c9c-b096-9091685db56e-konnectivity-ca\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-host-run-multus-certs\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099301 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlpc7\" (UniqueName: \"kubernetes.io/projected/ef36ec2d-05d8-4c25-b086-d4d248941fa1-kube-api-access-mlpc7\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099340 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-systemd\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099363 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-run\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099389 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099417 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-config\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099485 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-systemd\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1622cd0a-f809-4ad4-928a-1c05af2b04c7-run\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099618 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-multus-daemon-config\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099625 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-etc-kubernetes\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099655 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-system-cni-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099677 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-etc-kubernetes\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099682 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099707 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ddbfe5-c169-451c-b9ca-6425ea01c22a-tmp-dir\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099719 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-system-cni-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099758 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-etc-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099786 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-run-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.099881 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-cni-binary-copy\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100134 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca77f4f-c89f-4c40-80c8-fc99853e8f87-etc-openvswitch\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100137 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ddbfe5-c169-451c-b9ca-6425ea01c22a-tmp-dir\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6136ed07-28f6-428f-a671-9c65e8a8343b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovnkube-config\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.100700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6136ed07-28f6-428f-a671-9c65e8a8343b-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.101916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca77f4f-c89f-4c40-80c8-fc99853e8f87-ovn-node-metrics-cert\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.102114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-tmp\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.102690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.102171 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1622cd0a-f809-4ad4-928a-1c05af2b04c7-etc-tuned\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.108892 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.108867 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131ee351bb55ad6be954235ac6b9f987.slice/crio-7d4627e5926aa9c55e86fb642152d2c6abbdf04d3f2579e3c145406e33a67ae0 WatchSource:0}: Error finding container 7d4627e5926aa9c55e86fb642152d2c6abbdf04d3f2579e3c145406e33a67ae0: Status 404 returned error can't find the container with id 7d4627e5926aa9c55e86fb642152d2c6abbdf04d3f2579e3c145406e33a67ae0 Jun 02 18:39:50.109089 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.109072 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994b7340992241a93e28eb8a5fde6ba9.slice/crio-9feb49f0656c589ab14b05752fd03746ecbf288546e479511b9b3453d7d45660 WatchSource:0}: Error finding container 9feb49f0656c589ab14b05752fd03746ecbf288546e479511b9b3453d7d45660: Status 404 returned error can't find the container with id 9feb49f0656c589ab14b05752fd03746ecbf288546e479511b9b3453d7d45660 Jun 02 18:39:50.111226 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.111204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjxbx\" (UniqueName: \"kubernetes.io/projected/cca77f4f-c89f-4c40-80c8-fc99853e8f87-kube-api-access-jjxbx\") pod \"ovnkube-node-bzl2v\" (UID: \"cca77f4f-c89f-4c40-80c8-fc99853e8f87\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.113362 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.113337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5b58\" (UniqueName: \"kubernetes.io/projected/22ddbfe5-c169-451c-b9ca-6425ea01c22a-kube-api-access-v5b58\") pod \"node-resolver-jsg4n\" (UID: \"22ddbfe5-c169-451c-b9ca-6425ea01c22a\") " pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.113932 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.113465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcg6\" (UniqueName: \"kubernetes.io/projected/1622cd0a-f809-4ad4-928a-1c05af2b04c7-kube-api-access-2lcg6\") pod \"tuned-cmgrr\" (UID: \"1622cd0a-f809-4ad4-928a-1c05af2b04c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.113932 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.113901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlpc7\" (UniqueName: \"kubernetes.io/projected/ef36ec2d-05d8-4c25-b086-d4d248941fa1-kube-api-access-mlpc7\") pod \"node-ca-4dvvc\" (UID: \"ef36ec2d-05d8-4c25-b086-d4d248941fa1\") " pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.114026 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.113930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckcv\" (UniqueName: \"kubernetes.io/projected/6136ed07-28f6-428f-a671-9c65e8a8343b-kube-api-access-6ckcv\") pod \"multus-additional-cni-plugins-cpgk4\" (UID: \"6136ed07-28f6-428f-a671-9c65e8a8343b\") " pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.114100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.114081 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj7bs\" (UniqueName: \"kubernetes.io/projected/b28e8c65-fd48-4b8c-8e69-441fe99074a7-kube-api-access-cj7bs\") pod \"aws-ebs-csi-driver-node-t986b\" (UID: \"b28e8c65-fd48-4b8c-8e69-441fe99074a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.114141 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.114097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ldk\" (UniqueName: \"kubernetes.io/projected/579c7e8d-38ca-4c40-9992-8dfc4d562bd5-kube-api-access-d5ldk\") pod \"multus-db4bd\" (UID: \"579c7e8d-38ca-4c40-9992-8dfc4d562bd5\") " pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.114937 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.114916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8qrm\" (UniqueName: \"kubernetes.io/projected/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-kube-api-access-t8qrm\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:50.115808 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.115792 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:39:50.200748 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.200716 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv49x\" (UniqueName: \"kubernetes.io/projected/7007fb74-8c1f-4a3f-b714-4365c1b239ae-kube-api-access-qv49x\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.200903 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.200768 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7007fb74-8c1f-4a3f-b714-4365c1b239ae-iptables-alerter-script\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.200903 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.200884 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b70537-26d2-4c9c-b096-9091685db56e-agent-certs\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.200978 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.200950 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7007fb74-8c1f-4a3f-b714-4365c1b239ae-host-slash\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.201139 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.201010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7007fb74-8c1f-4a3f-b714-4365c1b239ae-host-slash\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.201139 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.201075 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b70537-26d2-4c9c-b096-9091685db56e-konnectivity-ca\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.201272 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.201156 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:50.201323 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.201290 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7007fb74-8c1f-4a3f-b714-4365c1b239ae-iptables-alerter-script\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.201820 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.201798 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b70537-26d2-4c9c-b096-9091685db56e-konnectivity-ca\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.203421 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.203403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b70537-26d2-4c9c-b096-9091685db56e-agent-certs\") pod \"konnectivity-agent-kdth9\" (UID: \"06b70537-26d2-4c9c-b096-9091685db56e\") " pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.208145 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.208131 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:50.208190 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.208148 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:50.208190 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.208157 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.208251 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.208216 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.70819951 +0000 UTC m=+2.244028323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.210104 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.210086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv49x\" (UniqueName: \"kubernetes.io/projected/7007fb74-8c1f-4a3f-b714-4365c1b239ae-kube-api-access-qv49x\") pod \"iptables-alerter-z6fqw\" (UID: \"7007fb74-8c1f-4a3f-b714-4365c1b239ae\") " pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.300490 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.300461 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" Jun 02 18:39:50.307322 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.307261 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28e8c65_fd48_4b8c_8e69_441fe99074a7.slice/crio-99c99ea82aca0626ed9001b4b73f9a1c3c4a13636ce43156461b187ab0f10085 WatchSource:0}: Error finding container 99c99ea82aca0626ed9001b4b73f9a1c3c4a13636ce43156461b187ab0f10085: Status 404 returned error can't find the container with id 99c99ea82aca0626ed9001b4b73f9a1c3c4a13636ce43156461b187ab0f10085 Jun 02 18:39:50.320437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.320420 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsg4n" Jun 02 18:39:50.327275 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.327250 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ddbfe5_c169_451c_b9ca_6425ea01c22a.slice/crio-0c9a0d153bcfc861d32e1b1a1cb7ea3e33fcc1fee1779c368f5a2c15c619b69a WatchSource:0}: Error finding container 0c9a0d153bcfc861d32e1b1a1cb7ea3e33fcc1fee1779c368f5a2c15c619b69a: Status 404 returned error can't find the container with id 0c9a0d153bcfc861d32e1b1a1cb7ea3e33fcc1fee1779c368f5a2c15c619b69a Jun 02 18:39:50.334254 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.334236 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4dvvc" Jun 02 18:39:50.340271 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.340246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef36ec2d_05d8_4c25_b086_d4d248941fa1.slice/crio-98bfc2559f9b0032ba0cb363889fe33df739b46680046cf73c7510b7e35c6131 WatchSource:0}: Error finding container 98bfc2559f9b0032ba0cb363889fe33df739b46680046cf73c7510b7e35c6131: Status 404 returned error can't find the container with id 98bfc2559f9b0032ba0cb363889fe33df739b46680046cf73c7510b7e35c6131 Jun 02 18:39:50.354221 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.354194 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:39:50.361996 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.361958 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca77f4f_c89f_4c40_80c8_fc99853e8f87.slice/crio-7fe68fb7eeb2e0049ff2884be23b92abb30f18f2c8d635207b467671852d8f13 WatchSource:0}: Error finding container 7fe68fb7eeb2e0049ff2884be23b92abb30f18f2c8d635207b467671852d8f13: Status 404 returned error can't find the container with id 7fe68fb7eeb2e0049ff2884be23b92abb30f18f2c8d635207b467671852d8f13 Jun 02 18:39:50.370753 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.370717 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" Jun 02 18:39:50.376404 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.376377 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1622cd0a_f809_4ad4_928a_1c05af2b04c7.slice/crio-1169c506691dacd168a503af6f22b59cf16adf0d4b38b13caf76f0b3fc014078 WatchSource:0}: Error finding container 1169c506691dacd168a503af6f22b59cf16adf0d4b38b13caf76f0b3fc014078: Status 404 returned error can't find the container with id 1169c506691dacd168a503af6f22b59cf16adf0d4b38b13caf76f0b3fc014078 Jun 02 18:39:50.393108 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.393081 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" Jun 02 18:39:50.399915 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.399893 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6136ed07_28f6_428f_a671_9c65e8a8343b.slice/crio-79996ce032b60a1c734585c7475797aec8965f125504cdad6a35ab1a1d4f2b79 WatchSource:0}: Error finding container 79996ce032b60a1c734585c7475797aec8965f125504cdad6a35ab1a1d4f2b79: Status 404 returned error can't find the container with id 79996ce032b60a1c734585c7475797aec8965f125504cdad6a35ab1a1d4f2b79 Jun 02 18:39:50.405000 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.404981 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-db4bd" Jun 02 18:39:50.411386 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.411363 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579c7e8d_38ca_4c40_9992_8dfc4d562bd5.slice/crio-dc0da7d712d6ef05c61d58fca83ebf165b2104f60f7b2ecef182c48146a48f2f WatchSource:0}: Error finding container dc0da7d712d6ef05c61d58fca83ebf165b2104f60f7b2ecef182c48146a48f2f: Status 404 returned error can't find the container with id dc0da7d712d6ef05c61d58fca83ebf165b2104f60f7b2ecef182c48146a48f2f Jun 02 18:39:50.415267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.415250 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6fqw" Jun 02 18:39:50.421100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.421071 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:39:50.421331 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.421305 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7007fb74_8c1f_4a3f_b714_4365c1b239ae.slice/crio-760204c0c8ea381928c7cdf82f3f689b7555aff88c4ebecd6dbae7b001ed2190 WatchSource:0}: Error finding container 760204c0c8ea381928c7cdf82f3f689b7555aff88c4ebecd6dbae7b001ed2190: Status 404 returned error can't find the container with id 760204c0c8ea381928c7cdf82f3f689b7555aff88c4ebecd6dbae7b001ed2190 Jun 02 18:39:50.427221 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:39:50.427196 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b70537_26d2_4c9c_b096_9091685db56e.slice/crio-b4a4c960f96685f4062fbcd718accdc71b71760deffeb7d4d6e972d3f0d861d1 WatchSource:0}: Error finding container b4a4c960f96685f4062fbcd718accdc71b71760deffeb7d4d6e972d3f0d861d1: Status 404 returned error can't find the container with id b4a4c960f96685f4062fbcd718accdc71b71760deffeb7d4d6e972d3f0d861d1 Jun 02 18:39:50.604131 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.604052 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:50.604280 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.604178 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.604280 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.604236 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:51.604219086 +0000 UTC m=+3.140047874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.805402 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.805367 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:50.805587 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.805534 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:50.805587 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.805559 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:50.805587 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.805573 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.805766 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:50.805636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:39:51.805617033 +0000 UTC m=+3.341445837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.937718 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:50.937638 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:51.029054 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.029009 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:50 +0000 UTC" deadline="2027-10-29 12:05:50.800436679 +0000 UTC" Jun 02 18:39:51.029054 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.029051 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12329h25m59.771390166s" Jun 02 18:39:51.111670 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.111640 2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:51.111954 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.111905 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"994b7340992241a93e28eb8a5fde6ba9","Type":"ContainerStarted","Data":"9feb49f0656c589ab14b05752fd03746ecbf288546e479511b9b3453d7d45660"} Jun 02 18:39:51.124265 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.124227 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdth9" event={"ID":"06b70537-26d2-4c9c-b096-9091685db56e","Type":"ContainerStarted","Data":"b4a4c960f96685f4062fbcd718accdc71b71760deffeb7d4d6e972d3f0d861d1"} Jun 02 18:39:51.143842 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.143768 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerStarted","Data":"79996ce032b60a1c734585c7475797aec8965f125504cdad6a35ab1a1d4f2b79"} Jun 02 18:39:51.152215 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.152177 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" event={"ID":"1622cd0a-f809-4ad4-928a-1c05af2b04c7","Type":"ContainerStarted","Data":"1169c506691dacd168a503af6f22b59cf16adf0d4b38b13caf76f0b3fc014078"} Jun 02 18:39:51.170063 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.170023 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4dvvc" event={"ID":"ef36ec2d-05d8-4c25-b086-d4d248941fa1","Type":"ContainerStarted","Data":"98bfc2559f9b0032ba0cb363889fe33df739b46680046cf73c7510b7e35c6131"} Jun 02 18:39:51.177279 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.177219 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsg4n" event={"ID":"22ddbfe5-c169-451c-b9ca-6425ea01c22a","Type":"ContainerStarted","Data":"0c9a0d153bcfc861d32e1b1a1cb7ea3e33fcc1fee1779c368f5a2c15c619b69a"} Jun 02 18:39:51.182456 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.182423 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" event={"ID":"131ee351bb55ad6be954235ac6b9f987","Type":"ContainerStarted","Data":"7d4627e5926aa9c55e86fb642152d2c6abbdf04d3f2579e3c145406e33a67ae0"} Jun 02 18:39:51.186915 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.186866 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6fqw" event={"ID":"7007fb74-8c1f-4a3f-b714-4365c1b239ae","Type":"ContainerStarted","Data":"760204c0c8ea381928c7cdf82f3f689b7555aff88c4ebecd6dbae7b001ed2190"} Jun 02 18:39:51.194599 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.194482 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-db4bd" event={"ID":"579c7e8d-38ca-4c40-9992-8dfc4d562bd5","Type":"ContainerStarted","Data":"dc0da7d712d6ef05c61d58fca83ebf165b2104f60f7b2ecef182c48146a48f2f"} Jun 02 18:39:51.200213 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.200180 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"7fe68fb7eeb2e0049ff2884be23b92abb30f18f2c8d635207b467671852d8f13"} Jun 02 18:39:51.210498 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.210464 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" event={"ID":"b28e8c65-fd48-4b8c-8e69-441fe99074a7","Type":"ContainerStarted","Data":"99c99ea82aca0626ed9001b4b73f9a1c3c4a13636ce43156461b187ab0f10085"} Jun 02 18:39:51.613114 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.613028 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:51.613271 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.613194 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:51.613324 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.613272 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:53.613252498 +0000 UTC m=+5.149081301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:51.816789 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:51.814898 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:51.816789 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.815076 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:51.816789 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.815102 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:51.816789 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.815117 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:51.816789 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:51.815177 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:39:53.81515712 +0000 UTC m=+5.350985916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:52.030049 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:52.029868 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:50 +0000 UTC" deadline="2028-03-02 19:36:47.453412972 +0000 UTC" Jun 02 18:39:52.030049 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:52.029911 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15336h56m55.423506261s" Jun 02 18:39:52.079657 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:52.079625 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:52.079854 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:52.079772 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:39:52.080796 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:52.079915 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:52.080796 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:52.080132 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:39:52.416113 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:52.416031 2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:53.630450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:53.630411 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:53.630962 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.630575 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:53.630962 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.630651 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:57.630629261 +0000 UTC m=+9.166458066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:53.832090 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:53.832049 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:53.832287 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.832258 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:53.832287 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.832280 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:53.832396 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.832293 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:53.832396 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:53.832354 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:39:57.832334555 +0000 UTC m=+9.368163361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:54.080613 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:54.079888 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:54.080613 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:54.080021 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:39:54.080613 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:54.080417 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:54.080613 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:54.080509 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:39:56.081202 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:56.080532 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:56.081202 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:56.080674 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:39:56.081202 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:56.081081 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:56.081202 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:56.081163 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:39:57.661428 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:57.661389 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:57.662024 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.661518 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:57.662024 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.661569 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:05.661555407 +0000 UTC m=+17.197384199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:57.863107 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:57.863065 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:57.863291 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.863236 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:57.863291 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.863258 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:57.863291 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.863271 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:57.863455 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:57.863336 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:05.86331985 +0000 UTC m=+17.399148656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:58.080569 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:58.080486 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:39:58.080749 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:58.080637 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:39:58.081027 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:39:58.080883 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:39:58.081027 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:39:58.080985 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:00.080380 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:00.080342 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:00.080863 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:00.080340 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:00.080863 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:00.080494 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:00.080863 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:00.080554 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:02.080488 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:02.080284 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:02.080987 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:02.080292 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:02.080987 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:02.080573 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:02.080987 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:02.080681 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:04.079980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:04.079936 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:04.080400 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:04.079936 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:04.080400 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:04.080069 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:04.080400 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:04.080114 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:05.721550 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:05.721509 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:05.721996 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.721673 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:05.721996 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.721754 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:21.721725812 +0000 UTC m=+33.257554600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:05.922752 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:05.922645 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:05.922897 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.922832 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:05.922897 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.922860 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:05.922897 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.922874 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:05.923014 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:05.922943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:21.922922838 +0000 UTC m=+33.458751633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:06.080434 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:06.080396 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:06.080638 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:06.080397 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:06.080638 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:06.080537 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:06.080638 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:06.080586 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:08.080515 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:08.080469 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:08.081057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:08.080478 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:08.081057 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:08.080602 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:08.081057 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:08.080702 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:10.080543 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.080518 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:10.080829 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:10.080624 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:10.080829 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.080668 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:10.080829 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:10.080768 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:10.246861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.246826 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" event={"ID":"131ee351bb55ad6be954235ac6b9f987","Type":"ContainerStarted","Data":"0d995c0aaf3208c84f339d88f40ba3a6bc508bbfc9ac307369c310f03e9947ee"} Jun 02 18:40:10.248177 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.248152 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-db4bd" event={"ID":"579c7e8d-38ca-4c40-9992-8dfc4d562bd5","Type":"ContainerStarted","Data":"662d18f7adede040c6ff93529ce6e2e6391d6c994ef362d743b8f56f29c790ff"} Jun 02 18:40:10.249372 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.249346 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" event={"ID":"1622cd0a-f809-4ad4-928a-1c05af2b04c7","Type":"ContainerStarted","Data":"5906e09b586e4c823ac9f13b6d3ef4553eb427020a11035876447269afdc8cc9"} Jun 02 18:40:10.279273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.279226 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" podStartSLOduration=21.279213124 podStartE2EDuration="21.279213124s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:40:10.259773104 +0000 UTC m=+21.795601915" watchObservedRunningTime="2026-06-02 18:40:10.279213124 +0000 UTC m=+21.815041981" Jun 02 18:40:10.279567 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.279547 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cmgrr" podStartSLOduration=1.726092129 podStartE2EDuration="21.279543341s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.377771251 +0000 UTC m=+1.913600039" lastFinishedPulling="2026-06-02 18:40:09.931222463 +0000 UTC m=+21.467051251" observedRunningTime="2026-06-02 18:40:10.278967904 +0000 UTC m=+21.814796717" watchObservedRunningTime="2026-06-02 18:40:10.279543341 +0000 UTC m=+21.815372151" Jun 02 18:40:10.295532 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:10.295495 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-db4bd" podStartSLOduration=1.7477028909999999 podStartE2EDuration="21.295481591s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.412885231 +0000 UTC m=+1.948714019" lastFinishedPulling="2026-06-02 18:40:09.960663931 +0000 UTC m=+21.496492719" observedRunningTime="2026-06-02 18:40:10.295060418 +0000 UTC m=+21.830889238" watchObservedRunningTime="2026-06-02 18:40:10.295481591 +0000 UTC m=+21.831310400" Jun 02 18:40:11.252703 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.252347 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdth9" event={"ID":"06b70537-26d2-4c9c-b096-9091685db56e","Type":"ContainerStarted","Data":"d26fdcee37ba462685e288309a1c957fa2b7eec86aa31ccaa55ff2b4f8f6d090"} Jun 02 18:40:11.253645 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.253622 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="673cbeed151d784bfbcbb5bfd8fd6dbc24b755e1e78f224c883d60febc8928f1" exitCode=0 Jun 02 18:40:11.253708 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.253688 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"673cbeed151d784bfbcbb5bfd8fd6dbc24b755e1e78f224c883d60febc8928f1"} Jun 02 18:40:11.254925 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.254901 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4dvvc" event={"ID":"ef36ec2d-05d8-4c25-b086-d4d248941fa1","Type":"ContainerStarted","Data":"374b670fb92cf1cbbee986db051a7acd9f4482efde6b518769854e6477d2d362"} Jun 02 18:40:11.256203 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.256177 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsg4n" event={"ID":"22ddbfe5-c169-451c-b9ca-6425ea01c22a","Type":"ContainerStarted","Data":"cfa5468bf654cd2a03fcea8c40e09f3138d32e613cd42b6b6fe65ee1e57b6e47"} Jun 02 18:40:11.258137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.258113 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"5787b4a1be3a7519ed5426ecef4505ab5922187e3d31c50c8acd5337cc275fde"} Jun 02 18:40:11.258137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.258135 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"cdb0e0fbd1c44c85c125d8d59fa870d66c1f3b2b7b644e513b38962737c287d6"} Jun 02 18:40:11.258257 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.258146 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"7d943ce4e31fd53a52cc6919288ad6421675fc4100614a1b13408b904f27f878"} Jun 02 18:40:11.261539 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.261516 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" event={"ID":"b28e8c65-fd48-4b8c-8e69-441fe99074a7","Type":"ContainerStarted","Data":"f85fa15817e6760d7658e40d22f7f9f26ca1d2e6a2ab2de9b0f3e2dd1ffed59e"} Jun 02 18:40:11.262938 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.262914 2564 generic.go:358] "Generic (PLEG): container finished" podID="994b7340992241a93e28eb8a5fde6ba9" containerID="b17769f467eb1b9f387d359f5446842eff058930cc21ebc9c2b53baeda02ad28" exitCode=0 Jun 02 18:40:11.263049 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.263026 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"994b7340992241a93e28eb8a5fde6ba9","Type":"ContainerDied","Data":"b17769f467eb1b9f387d359f5446842eff058930cc21ebc9c2b53baeda02ad28"} Jun 02 18:40:11.303588 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.303531 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jsg4n" podStartSLOduration=2.702430979 podStartE2EDuration="22.303512003s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.328862968 +0000 UTC m=+1.864691756" lastFinishedPulling="2026-06-02 18:40:09.929943977 +0000 UTC m=+21.465772780" observedRunningTime="2026-06-02 18:40:11.302673882 +0000 UTC m=+22.838502707" watchObservedRunningTime="2026-06-02 18:40:11.303512003 +0000 UTC m=+22.839340813" Jun 02 18:40:11.335461 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.334834 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4dvvc" podStartSLOduration=7.512031079 podStartE2EDuration="22.334816494s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.341863898 +0000 UTC m=+1.877692685" lastFinishedPulling="2026-06-02 18:40:05.164649298 +0000 UTC m=+16.700478100" observedRunningTime="2026-06-02 18:40:11.318631812 +0000 UTC m=+22.854460624" watchObservedRunningTime="2026-06-02 18:40:11.334816494 +0000 UTC m=+22.870645336" Jun 02 18:40:11.919144 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:11.919096 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:40:12.080021 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.079991 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:12.080171 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.079991 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:12.080171 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:12.080118 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:12.080279 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:12.080166 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:12.167622 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.167578 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 18:40:12.265810 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.265771 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6fqw" event={"ID":"7007fb74-8c1f-4a3f-b714-4365c1b239ae","Type":"ContainerStarted","Data":"fe707f82951c3951ebaccd391411d45dc6a72bf440035d2981628a00273f859c"} Jun 02 18:40:12.268869 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.268841 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"1106b098dfd797f0fa2ca4778a94e826f56d727033c3d796704ec4bdb336778e"} Jun 02 18:40:12.269004 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.268877 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"f0ea5edf19457dc398c6b19357bb0c6de395771859d1687d28fe73961ea9f496"} Jun 02 18:40:12.269004 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.268892 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"c238f0790e8894503252586d31e80a49c0ec0bcc0c521a8adf90d63f8d2c45a8"} Jun 02 18:40:12.270540 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.270516 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" event={"ID":"b28e8c65-fd48-4b8c-8e69-441fe99074a7","Type":"ContainerStarted","Data":"2fccf17d85698d40d1cf7d16b3eaae2070f18e478a4076ca2fb228bb711911b3"} Jun 02 18:40:12.272119 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.272091 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"994b7340992241a93e28eb8a5fde6ba9","Type":"ContainerStarted","Data":"6101efa6608a92307992dcdd8bed738645f382d09c9ca3766e173d5163190436"} Jun 02 18:40:12.282631 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.282594 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z6fqw" podStartSLOduration=3.777030871 podStartE2EDuration="23.282581421s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.423950257 +0000 UTC m=+1.959779045" lastFinishedPulling="2026-06-02 18:40:09.929500792 +0000 UTC m=+21.465329595" observedRunningTime="2026-06-02 18:40:12.282182397 +0000 UTC m=+23.818011208" watchObservedRunningTime="2026-06-02 18:40:12.282581421 +0000 UTC m=+23.818410230" Jun 02 18:40:12.282728 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.282663 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdth9" podStartSLOduration=3.7814034960000003 podStartE2EDuration="23.282658765s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.428651806 +0000 UTC m=+1.964480595" lastFinishedPulling="2026-06-02 18:40:09.929907066 +0000 UTC m=+21.465735864" observedRunningTime="2026-06-02 18:40:11.334596977 +0000 UTC m=+22.870425806" watchObservedRunningTime="2026-06-02 18:40:12.282658765 +0000 UTC m=+23.818487574" Jun 02 18:40:12.296462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.296429 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:40:12.297156 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.297136 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:40:12.314572 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:12.314489 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" podStartSLOduration=23.314473668 podStartE2EDuration="23.314473668s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:40:12.298894981 +0000 UTC m=+23.834723791" watchObservedRunningTime="2026-06-02 18:40:12.314473668 +0000 UTC m=+23.850302479" Jun 02 18:40:13.069652 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.069508 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T18:40:12.167593022Z","UUID":"ed644493-5e16-4b28-81c1-71aab544e364","Handler":null,"Name":"","Endpoint":""} Jun 02 18:40:13.072980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.072954 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 18:40:13.072980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.072984 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 18:40:13.276926 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.276667 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" event={"ID":"b28e8c65-fd48-4b8c-8e69-441fe99074a7","Type":"ContainerStarted","Data":"99aabe97ae1061437c15418684da08c647540e45363a060f1eb65e1c3c62da53"} Jun 02 18:40:13.277677 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.277655 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdth9" Jun 02 18:40:13.294362 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:13.294304 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t986b" podStartSLOduration=1.507591173 podStartE2EDuration="24.294288302s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.308881194 +0000 UTC m=+1.844709982" lastFinishedPulling="2026-06-02 18:40:13.095578309 +0000 UTC m=+24.631407111" observedRunningTime="2026-06-02 18:40:13.294014831 +0000 UTC m=+24.829843643" watchObservedRunningTime="2026-06-02 18:40:13.294288302 +0000 UTC m=+24.830117116" Jun 02 18:40:14.080062 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:14.080025 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:14.080273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:14.080037 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:14.080273 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:14.080172 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:14.080388 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:14.080314 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:16.080219 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:16.080186 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:16.080878 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:16.080187 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:16.080878 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:16.080296 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:16.080878 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:16.080366 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:16.284226 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:16.284187 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"ab9defe83d1a895acee8daf034259f14bfa145fe262a1efb334739a67289d97c"} Jun 02 18:40:16.285592 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:16.285566 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="64a2bc1cb01a4f1b4300a52c26275c34e0d5a661d846143fbe7c551de5d11cd7" exitCode=0 Jun 02 18:40:16.285715 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:16.285610 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"64a2bc1cb01a4f1b4300a52c26275c34e0d5a661d846143fbe7c551de5d11cd7"} Jun 02 18:40:17.288835 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:17.288792 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="0b736f720c8de7cd4b586a7e98a6b5acdd405775b87a0f305259078742f915e6" exitCode=0 Jun 02 18:40:17.289184 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:17.288840 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"0b736f720c8de7cd4b586a7e98a6b5acdd405775b87a0f305259078742f915e6"} Jun 02 18:40:18.080281 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.080087 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:18.080411 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.080088 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:18.080411 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:18.080367 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:18.080494 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:18.080438 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:18.293577 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.293540 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" event={"ID":"cca77f4f-c89f-4c40-80c8-fc99853e8f87","Type":"ContainerStarted","Data":"f0b4439f624b6fadd6d9d04cd79b04061d8d4f06fa88eedb501839d01eb6592d"} Jun 02 18:40:18.294175 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.293916 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:18.294175 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.293945 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:18.296342 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.296318 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="1aaad2f4d2489eefec5f95a6ab7144f580f29be6eb881b9ff351a9c42b5b22b9" exitCode=0 Jun 02 18:40:18.296500 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.296356 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"1aaad2f4d2489eefec5f95a6ab7144f580f29be6eb881b9ff351a9c42b5b22b9"} Jun 02 18:40:18.310549 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.310525 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:18.320102 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:18.320057 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" podStartSLOduration=9.094049563 podStartE2EDuration="29.320043353s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.363432646 +0000 UTC m=+1.899261435" lastFinishedPulling="2026-06-02 18:40:10.589426417 +0000 UTC m=+22.125255225" observedRunningTime="2026-06-02 18:40:18.3194374 +0000 UTC m=+29.855266209" watchObservedRunningTime="2026-06-02 18:40:18.320043353 +0000 UTC m=+29.855872162" Jun 02 18:40:19.299134 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.299082 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:19.319705 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.319668 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:19.377290 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.377250 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tg4q"] Jun 02 18:40:19.377450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.377405 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:19.377535 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:19.377508 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:19.380980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.380659 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jq5kp"] Jun 02 18:40:19.380980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:19.380814 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:19.380980 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:19.380934 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:21.080163 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:21.079973 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:21.080636 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:21.080017 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:21.080636 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.080251 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:21.080636 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.080334 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:21.735583 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:21.735486 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:21.735761 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.735610 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:21.735761 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.735676 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.735658887 +0000 UTC m=+65.271487679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:21.937592 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:21.937533 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:21.937813 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.937722 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:21.937813 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.937762 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:21.937813 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.937776 2564 projected.go:194] Error preparing data for projected volume kube-api-access-hnkhq for pod openshift-network-diagnostics/network-check-target-7tg4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:21.937980 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:21.937837 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq podName:d498004a-2682-4471-b0ab-e3f784c60b4f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.937815597 +0000 UTC m=+65.473644400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnkhq" (UniqueName: "kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq") pod "network-check-target-7tg4q" (UID: "d498004a-2682-4471-b0ab-e3f784c60b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:23.079951 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.079915 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:23.080542 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.080045 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tg4q" podUID="d498004a-2682-4471-b0ab-e3f784c60b4f" Jun 02 18:40:23.080542 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.080088 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:23.080542 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.080183 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jq5kp" podUID="d8450680-f5e4-45f1-bca1-1cc13fd0ddd1" Jun 02 18:40:23.232188 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.232110 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeReady" Jun 02 18:40:23.232659 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.232633 2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 18:40:23.278147 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.278118 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m5szk"] Jun 02 18:40:23.346228 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.346181 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8nx9h"] Jun 02 18:40:23.346401 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.346372 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.349276 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.349250 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 18:40:23.349276 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.349267 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:40:23.349477 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.349282 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 18:40:23.361048 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.361027 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5szk"] Jun 02 18:40:23.361146 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.361053 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8nx9h"] Jun 02 18:40:23.361146 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.361135 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:23.376821 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.376799 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 18:40:23.377017 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.376981 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:40:23.377017 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.377003 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 18:40:23.385660 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.385638 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 18:40:23.446866 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.446824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbj2d\" (UniqueName: \"kubernetes.io/projected/4cb8dd1f-abce-4d90-804a-3b97495e745e-kube-api-access-lbj2d\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:23.447062 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.446887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.447062 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.446942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b757491-e6d2-4191-ad6d-cee837dbd02b-config-volume\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.447062 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.446969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b757491-e6d2-4191-ad6d-cee837dbd02b-tmp-dir\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.447062 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.447028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:23.447212 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.447079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58626\" (UniqueName: \"kubernetes.io/projected/8b757491-e6d2-4191-ad6d-cee837dbd02b-kube-api-access-58626\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.548369 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548336 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:23.548562 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548395 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58626\" (UniqueName: \"kubernetes.io/projected/8b757491-e6d2-4191-ad6d-cee837dbd02b-kube-api-access-58626\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.548562 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.548508 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:23.548562 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548525 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbj2d\" (UniqueName: \"kubernetes.io/projected/4cb8dd1f-abce-4d90-804a-3b97495e745e-kube-api-access-lbj2d\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:23.548775 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.548579 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:24.048557823 +0000 UTC m=+35.584386618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:23.548775 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548612 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.548775 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548649 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b757491-e6d2-4191-ad6d-cee837dbd02b-config-volume\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.548775 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.548674 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b757491-e6d2-4191-ad6d-cee837dbd02b-tmp-dir\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.548775 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.548757 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:23.548997 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:23.548808 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:24.048795418 +0000 UTC m=+35.584624211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:23.552685 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.552663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b757491-e6d2-4191-ad6d-cee837dbd02b-tmp-dir\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.552883 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.552851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b757491-e6d2-4191-ad6d-cee837dbd02b-config-volume\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.562520 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.562494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58626\" (UniqueName: \"kubernetes.io/projected/8b757491-e6d2-4191-ad6d-cee837dbd02b-kube-api-access-58626\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:23.562677 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:23.562576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbj2d\" (UniqueName: \"kubernetes.io/projected/4cb8dd1f-abce-4d90-804a-3b97495e745e-kube-api-access-lbj2d\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:24.052643 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:24.052607 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:24.052836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:24.052667 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:24.052836 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:24.052765 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:24.052836 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:24.052769 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:24.052836 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:24.052818 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:25.05280348 +0000 UTC m=+36.588632271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:24.052836 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:24.052830 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:25.052824788 +0000 UTC m=+36.588653576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:25.060335 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.060297 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:25.061090 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.060365 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:25.061090 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:25.060456 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:25.061090 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:25.060465 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:25.061090 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:25.060506 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:27.060492323 +0000 UTC m=+38.596321115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:25.061090 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:25.060532 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:27.060512391 +0000 UTC m=+38.596341202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:25.080372 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.080343 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:25.080556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.080536 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:25.084639 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.084618 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:25.084871 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.084851 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:25.084871 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.084866 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:25.085003 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.084904 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:40:25.085003 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.084914 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:25.312975 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.312884 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="de579ddd62fa0350135526f03480d3df9086d003db2057293e2d7c3eed33a48f" exitCode=0 Jun 02 18:40:25.312975 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:25.312936 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"de579ddd62fa0350135526f03480d3df9086d003db2057293e2d7c3eed33a48f"} Jun 02 18:40:26.318057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:26.318021 2564 generic.go:358] "Generic (PLEG): container finished" podID="6136ed07-28f6-428f-a671-9c65e8a8343b" containerID="e898b8996c54d74415a26a89c0f2ab93ae2d13d5e77365d5417ed7836e5792b5" exitCode=0 Jun 02 18:40:26.318515 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:26.318066 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerDied","Data":"e898b8996c54d74415a26a89c0f2ab93ae2d13d5e77365d5417ed7836e5792b5"} Jun 02 18:40:27.073030 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:27.072992 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:27.073216 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:27.073044 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:27.073216 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:27.073149 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:27.073216 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:27.073152 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:27.073216 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:27.073201 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:31.073188192 +0000 UTC m=+42.609016986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:27.073216 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:27.073214 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:31.073208512 +0000 UTC m=+42.609037302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:27.322665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:27.322635 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" event={"ID":"6136ed07-28f6-428f-a671-9c65e8a8343b","Type":"ContainerStarted","Data":"0a0366b66afd34c4531469e4a2afee30d680133f0d14fbfffed20407e6e988d5"} Jun 02 18:40:27.350929 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:27.350826 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cpgk4" podStartSLOduration=4.522401253 podStartE2EDuration="38.350811038s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.401450235 +0000 UTC m=+1.937279038" lastFinishedPulling="2026-06-02 18:40:24.229860035 +0000 UTC m=+35.765688823" observedRunningTime="2026-06-02 18:40:27.349108764 +0000 UTC m=+38.884937573" watchObservedRunningTime="2026-06-02 18:40:27.350811038 +0000 UTC m=+38.886639844" Jun 02 18:40:31.101689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:31.101503 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:31.102094 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:31.101727 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:31.102094 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:31.101650 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:31.102094 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:31.101811 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:39.10179609 +0000 UTC m=+50.637624878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:31.102094 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:31.101836 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:31.102094 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:31.101887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:39.101872821 +0000 UTC m=+50.637701630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:39.156672 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:39.156629 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:39.157104 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:39.156699 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:39.157104 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:39.156795 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:39.157104 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:39.156812 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:39.157104 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:39.156869 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:40:55.156853672 +0000 UTC m=+66.692682465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:39.157104 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:39.156883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:55.156877109 +0000 UTC m=+66.692705899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:51.312687 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:51.312655 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzl2v" Jun 02 18:40:53.756379 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.756316 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:40:53.759230 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.759209 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:53.767597 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:53.767570 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 18:40:53.767683 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:53.767657 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs podName:d8450680-f5e4-45f1-bca1-1cc13fd0ddd1 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:57.767638297 +0000 UTC m=+129.303467085 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs") pod "network-metrics-daemon-jq5kp" (UID: "d8450680-f5e4-45f1-bca1-1cc13fd0ddd1") : secret "metrics-daemon-secret" not found Jun 02 18:40:53.957482 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.957428 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:53.960721 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.960704 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:53.971055 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.971032 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:53.981460 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:53.981437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnkhq\" (UniqueName: \"kubernetes.io/projected/d498004a-2682-4471-b0ab-e3f784c60b4f-kube-api-access-hnkhq\") pod \"network-check-target-7tg4q\" (UID: \"d498004a-2682-4471-b0ab-e3f784c60b4f\") " pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:54.197592 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:54.197558 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:54.204897 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:54.204877 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:54.341756 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:54.341707 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tg4q"] Jun 02 18:40:54.345136 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:40:54.345099 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd498004a_2682_4471_b0ab_e3f784c60b4f.slice/crio-1fd5cf1434a92e4f2589150d13bc78d995eccc7ba4e41bee5343cc4f179c0cb4 WatchSource:0}: Error finding container 1fd5cf1434a92e4f2589150d13bc78d995eccc7ba4e41bee5343cc4f179c0cb4: Status 404 returned error can't find the container with id 1fd5cf1434a92e4f2589150d13bc78d995eccc7ba4e41bee5343cc4f179c0cb4 Jun 02 18:40:54.372814 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:54.372776 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tg4q" event={"ID":"d498004a-2682-4471-b0ab-e3f784c60b4f","Type":"ContainerStarted","Data":"1fd5cf1434a92e4f2589150d13bc78d995eccc7ba4e41bee5343cc4f179c0cb4"} Jun 02 18:40:55.168703 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:55.168662 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:40:55.169108 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:55.168728 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:40:55.169108 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:55.168840 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:55.169108 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:55.168898 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:55.169108 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:55.168913 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:41:27.168895734 +0000 UTC m=+98.704724522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:40:55.169108 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:40:55.168950 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:41:27.168934546 +0000 UTC m=+98.704763350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:40:58.381455 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:58.381417 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tg4q" event={"ID":"d498004a-2682-4471-b0ab-e3f784c60b4f","Type":"ContainerStarted","Data":"5db213d675f359beb5697d16897a74dfb70e6dea157a92dc9623a5eb7165e6de"} Jun 02 18:40:58.381880 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:58.381543 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:40:58.396411 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:40:58.396367 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tg4q" podStartSLOduration=66.157938128 podStartE2EDuration="1m9.396356479s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:40:54.347409568 +0000 UTC m=+65.883238356" lastFinishedPulling="2026-06-02 18:40:57.585827905 +0000 UTC m=+69.121656707" observedRunningTime="2026-06-02 18:40:58.396021327 +0000 UTC m=+69.931850138" watchObservedRunningTime="2026-06-02 18:40:58.396356479 +0000 UTC m=+69.932185320" Jun 02 18:41:01.227187 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.227153 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk"] Jun 02 18:41:01.228691 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.228675 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.231530 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.231506 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 18:41:01.231633 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.231506 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 18:41:01.231633 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.231552 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-km2ml\"" Jun 02 18:41:01.232884 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.232867 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 18:41:01.233122 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.233108 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 18:41:01.238954 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.238928 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk"] Jun 02 18:41:01.242305 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.242283 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966"] Jun 02 18:41:01.243896 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.243879 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.246370 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.246354 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 18:41:01.246540 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.246526 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 18:41:01.246610 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.246550 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 18:41:01.246610 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.246560 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 18:41:01.254087 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.254065 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966"] Jun 02 18:41:01.411141 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.411141 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.411337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ts9\" (UniqueName: \"kubernetes.io/projected/368bed9d-2f40-4d8f-8a42-c0fd772289f9-kube-api-access-c6ts9\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.411337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.411337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c954cd-dee8-4e17-96be-8da458b5fbdf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.411337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsv2m\" (UniqueName: \"kubernetes.io/projected/03c954cd-dee8-4e17-96be-8da458b5fbdf-kube-api-access-bsv2m\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.411462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.411462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.411395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.511941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.511859 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ts9\" (UniqueName: \"kubernetes.io/projected/368bed9d-2f40-4d8f-8a42-c0fd772289f9-kube-api-access-c6ts9\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.511941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.511906 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.511941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.511938 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c954cd-dee8-4e17-96be-8da458b5fbdf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.512162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.511967 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsv2m\" (UniqueName: \"kubernetes.io/projected/03c954cd-dee8-4e17-96be-8da458b5fbdf-kube-api-access-bsv2m\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.512162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.511987 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.512162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.512013 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.512314 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.512177 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.512314 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.512221 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.513222 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.513189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.514708 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.514664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-ca\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.514847 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.514819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.514847 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.514838 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.515418 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.515396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/368bed9d-2f40-4d8f-8a42-c0fd772289f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.515492 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.515403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c954cd-dee8-4e17-96be-8da458b5fbdf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.520220 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.520193 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsv2m\" (UniqueName: \"kubernetes.io/projected/03c954cd-dee8-4e17-96be-8da458b5fbdf-kube-api-access-bsv2m\") pod \"managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk\" (UID: \"03c954cd-dee8-4e17-96be-8da458b5fbdf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.520220 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.520209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ts9\" (UniqueName: \"kubernetes.io/projected/368bed9d-2f40-4d8f-8a42-c0fd772289f9-kube-api-access-c6ts9\") pod \"cluster-proxy-proxy-agent-7bc9c946d7-ht966\" (UID: \"368bed9d-2f40-4d8f-8a42-c0fd772289f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.554219 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.554191 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" Jun 02 18:41:01.561994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.561970 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:41:01.700671 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.700582 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk"] Jun 02 18:41:01.704160 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:41:01.704128 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03c954cd_dee8_4e17_96be_8da458b5fbdf.slice/crio-33b817ea6d3f3ecff4206be87b07f487bcc2b4d3d809e6cf48ef53cd4ad7f792 WatchSource:0}: Error finding container 33b817ea6d3f3ecff4206be87b07f487bcc2b4d3d809e6cf48ef53cd4ad7f792: Status 404 returned error can't find the container with id 33b817ea6d3f3ecff4206be87b07f487bcc2b4d3d809e6cf48ef53cd4ad7f792 Jun 02 18:41:01.720358 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:01.720336 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966"] Jun 02 18:41:01.723459 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:41:01.723434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod368bed9d_2f40_4d8f_8a42_c0fd772289f9.slice/crio-c6c96581a3a702d38f59aa9c36acf791b8e88154808f2d2891af8fc30e34b36f WatchSource:0}: Error finding container c6c96581a3a702d38f59aa9c36acf791b8e88154808f2d2891af8fc30e34b36f: Status 404 returned error can't find the container with id c6c96581a3a702d38f59aa9c36acf791b8e88154808f2d2891af8fc30e34b36f Jun 02 18:41:02.390706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:02.390666 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerStarted","Data":"c6c96581a3a702d38f59aa9c36acf791b8e88154808f2d2891af8fc30e34b36f"} Jun 02 18:41:02.391802 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:02.391766 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" event={"ID":"03c954cd-dee8-4e17-96be-8da458b5fbdf","Type":"ContainerStarted","Data":"33b817ea6d3f3ecff4206be87b07f487bcc2b4d3d809e6cf48ef53cd4ad7f792"} Jun 02 18:41:06.401393 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:06.401352 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" event={"ID":"03c954cd-dee8-4e17-96be-8da458b5fbdf","Type":"ContainerStarted","Data":"d34bc85ee486b058e516ff59df9f4e06a6ba0a981ce30911412406ba38bfe838"} Jun 02 18:41:06.402536 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:06.402516 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerStarted","Data":"3c127669d25f2afb17da5d43604b5d7d530975c4a8aa3dd299fd46314f9114f9"} Jun 02 18:41:06.416159 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:06.416120 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f5fd8b7c4-8zfhk" podStartSLOduration=1.272986816 podStartE2EDuration="5.4161086s" podCreationTimestamp="2026-06-02 18:41:01 +0000 UTC" firstStartedPulling="2026-06-02 18:41:01.707832666 +0000 UTC m=+73.243661454" lastFinishedPulling="2026-06-02 18:41:05.850954433 +0000 UTC m=+77.386783238" observedRunningTime="2026-06-02 18:41:06.415937409 +0000 UTC m=+77.951766229" watchObservedRunningTime="2026-06-02 18:41:06.4161086 +0000 UTC m=+77.951937409" Jun 02 18:41:09.409460 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:09.409421 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerStarted","Data":"5a97abf517297684f418e53a87b5332ca5b8c3c6b47f062831bbc3c30a2f8b5a"} Jun 02 18:41:09.409912 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:09.409468 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerStarted","Data":"e2fb32f9ec4bf9fbe9535d6d33442f80219f40415210f5e65bbaad4801f163a9"} Jun 02 18:41:09.442877 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:09.442823 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" podStartSLOduration=1.492682848 podStartE2EDuration="8.442810714s" podCreationTimestamp="2026-06-02 18:41:01 +0000 UTC" firstStartedPulling="2026-06-02 18:41:01.725117447 +0000 UTC m=+73.260946239" lastFinishedPulling="2026-06-02 18:41:08.675245317 +0000 UTC m=+80.211074105" observedRunningTime="2026-06-02 18:41:09.441184658 +0000 UTC m=+80.977013468" watchObservedRunningTime="2026-06-02 18:41:09.442810714 +0000 UTC m=+80.978639523" Jun 02 18:41:27.188149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:27.188108 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:41:27.188589 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:27.188165 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:41:27.188589 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:41:27.188257 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:41:27.188589 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:41:27.188266 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:41:27.188589 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:41:27.188317 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls podName:8b757491-e6d2-4191-ad6d-cee837dbd02b nodeName:}" failed. No retries permitted until 2026-06-02 18:42:31.188304945 +0000 UTC m=+162.724133736 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls") pod "dns-default-m5szk" (UID: "8b757491-e6d2-4191-ad6d-cee837dbd02b") : secret "dns-default-metrics-tls" not found Jun 02 18:41:27.188589 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:41:27.188345 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert podName:4cb8dd1f-abce-4d90-804a-3b97495e745e nodeName:}" failed. No retries permitted until 2026-06-02 18:42:31.188327943 +0000 UTC m=+162.724156734 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert") pod "ingress-canary-8nx9h" (UID: "4cb8dd1f-abce-4d90-804a-3b97495e745e") : secret "canary-serving-cert" not found Jun 02 18:41:29.386573 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:29.386544 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tg4q" Jun 02 18:41:43.788714 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:43.788686 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jsg4n_22ddbfe5-c169-451c-b9ca-6425ea01c22a/dns-node-resolver/0.log" Jun 02 18:41:44.606796 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:44.606756 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4dvvc_ef36ec2d-05d8-4c25-b086-d4d248941fa1/node-ca/0.log" Jun 02 18:41:57.812960 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:57.812907 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:41:57.815322 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:57.815299 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8450680-f5e4-45f1-bca1-1cc13fd0ddd1-metrics-certs\") pod \"network-metrics-daemon-jq5kp\" (UID: \"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1\") " pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:41:58.093104 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:58.093020 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:41:58.101282 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:58.101245 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jq5kp" Jun 02 18:41:58.220538 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:58.220511 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jq5kp"] Jun 02 18:41:58.223839 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:41:58.223817 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8450680_f5e4_45f1_bca1_1cc13fd0ddd1.slice/crio-15c35f99bc74bcc1664d67c968dfd85c10d8c2d19a74ec27afd5c710557cc4ef WatchSource:0}: Error finding container 15c35f99bc74bcc1664d67c968dfd85c10d8c2d19a74ec27afd5c710557cc4ef: Status 404 returned error can't find the container with id 15c35f99bc74bcc1664d67c968dfd85c10d8c2d19a74ec27afd5c710557cc4ef Jun 02 18:41:58.503529 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:58.503444 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jq5kp" event={"ID":"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1","Type":"ContainerStarted","Data":"15c35f99bc74bcc1664d67c968dfd85c10d8c2d19a74ec27afd5c710557cc4ef"} Jun 02 18:41:59.508086 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:59.507992 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jq5kp" event={"ID":"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1","Type":"ContainerStarted","Data":"6558111553a43110aece10ea22d35c2ce8be2da3eff51ea4f45bfb987b74b712"} Jun 02 18:41:59.508086 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:59.508032 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jq5kp" event={"ID":"d8450680-f5e4-45f1-bca1-1cc13fd0ddd1","Type":"ContainerStarted","Data":"d40ef271c304c94d871e63b643d32ef6f1b6ecd76a5ed9b192b1c5cd1d13aa12"} Jun 02 18:41:59.525694 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:41:59.525644 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jq5kp" podStartSLOduration=129.693263467 podStartE2EDuration="2m10.525627082s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:41:58.225401889 +0000 UTC m=+129.761230691" lastFinishedPulling="2026-06-02 18:41:59.057765503 +0000 UTC m=+130.593594306" observedRunningTime="2026-06-02 18:41:59.524209207 +0000 UTC m=+131.060038017" watchObservedRunningTime="2026-06-02 18:41:59.525627082 +0000 UTC m=+131.061455891" Jun 02 18:42:07.629021 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.628984 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l6jck"] Jun 02 18:42:07.632144 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.632124 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.635041 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.635019 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 18:42:07.636412 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.636392 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 18:42:07.636534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.636415 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wpbjj\"" Jun 02 18:42:07.636534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.636430 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 18:42:07.636534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.636435 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 18:42:07.647623 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.647599 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6jck"] Jun 02 18:42:07.680571 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.680536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-data-volume\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.680571 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.680572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.680806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.680597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-api-access-fxjtn\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.680806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.680618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.680806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.680705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-crio-socket\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782025 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.781983 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782025 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782027 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-api-access-fxjtn\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782147 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782218 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-crio-socket\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782372 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782286 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-data-volume\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782372 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-crio-socket\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782591 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-data-volume\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.782661 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.782644 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.784661 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.784640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.794299 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.794276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/1e5d9032-ca56-4eaf-9e89-5140e09b76a0-kube-api-access-fxjtn\") pod \"insights-runtime-extractor-l6jck\" (UID: \"1e5d9032-ca56-4eaf-9e89-5140e09b76a0\") " pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:07.941625 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:07.941530 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6jck" Jun 02 18:42:08.066220 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:08.066182 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6jck"] Jun 02 18:42:08.069449 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:08.069424 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5d9032_ca56_4eaf_9e89_5140e09b76a0.slice/crio-ee48526afcfd64b66916d75eb03f34a9200b44afa9e35c9fa77443bfd1e758ce WatchSource:0}: Error finding container ee48526afcfd64b66916d75eb03f34a9200b44afa9e35c9fa77443bfd1e758ce: Status 404 returned error can't find the container with id ee48526afcfd64b66916d75eb03f34a9200b44afa9e35c9fa77443bfd1e758ce Jun 02 18:42:08.534359 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:08.534324 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6jck" event={"ID":"1e5d9032-ca56-4eaf-9e89-5140e09b76a0","Type":"ContainerStarted","Data":"c46e0c0a92e301e5dae5f20ec4222a94a317548e6bc2ed5d96cb623f0571d6a6"} Jun 02 18:42:08.534359 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:08.534360 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6jck" event={"ID":"1e5d9032-ca56-4eaf-9e89-5140e09b76a0","Type":"ContainerStarted","Data":"ee48526afcfd64b66916d75eb03f34a9200b44afa9e35c9fa77443bfd1e758ce"} Jun 02 18:42:09.539057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:09.539012 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6jck" event={"ID":"1e5d9032-ca56-4eaf-9e89-5140e09b76a0","Type":"ContainerStarted","Data":"99ad45361ceef798dcffcbedac1ed5b95dda9703784496e72a75b7a523604df1"} Jun 02 18:42:11.154468 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.154425 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:11.157500 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.157478 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.160446 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.160420 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 18:42:11.161956 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.161926 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 18:42:11.162068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.161967 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 18:42:11.162068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.161983 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 18:42:11.162068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.161987 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 18:42:11.162068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.162007 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnkn5\"" Jun 02 18:42:11.162068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.161936 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 18:42:11.162327 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.162075 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 18:42:11.168651 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.168629 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:11.205977 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.205945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.206137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.205983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf8hh\" (UniqueName: \"kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.206137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.206010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.206137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.206057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.206137 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.206108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.206267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.206176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307124 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307070 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307124 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307119 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307373 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307242 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307373 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307347 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307474 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307414 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307474 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307443 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf8hh\" (UniqueName: \"kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307804 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307922 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.307983 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.307966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.309841 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.309813 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.309841 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.309836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.315211 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.315191 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf8hh\" (UniqueName: \"kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh\") pod \"console-687dd8f96-bvbgz\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.466798 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.466681 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:11.547695 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.547662 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6jck" event={"ID":"1e5d9032-ca56-4eaf-9e89-5140e09b76a0","Type":"ContainerStarted","Data":"0d86bb5eb85fd6caf038c6177c35d7c4cc5e5c879136641470a7455698b14ebf"} Jun 02 18:42:11.565880 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.565829 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l6jck" podStartSLOduration=2.097685935 podStartE2EDuration="4.565813142s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="2026-06-02 18:42:08.127535407 +0000 UTC m=+139.663364199" lastFinishedPulling="2026-06-02 18:42:10.595662615 +0000 UTC m=+142.131491406" observedRunningTime="2026-06-02 18:42:11.564380969 +0000 UTC m=+143.100209804" watchObservedRunningTime="2026-06-02 18:42:11.565813142 +0000 UTC m=+143.101641953" Jun 02 18:42:11.592478 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:11.592444 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:11.595391 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:11.595360 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb86db9_ef82_445a_9e9b_c2091cbd19f1.slice/crio-f230261aa7fca6298fb6bd2c800a0ea5dfec31b82df7865a5fdf90cd8ce8250d WatchSource:0}: Error finding container f230261aa7fca6298fb6bd2c800a0ea5dfec31b82df7865a5fdf90cd8ce8250d: Status 404 returned error can't find the container with id f230261aa7fca6298fb6bd2c800a0ea5dfec31b82df7865a5fdf90cd8ce8250d Jun 02 18:42:12.551211 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:12.551172 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd8f96-bvbgz" event={"ID":"0eb86db9-ef82-445a-9e9b-c2091cbd19f1","Type":"ContainerStarted","Data":"f230261aa7fca6298fb6bd2c800a0ea5dfec31b82df7865a5fdf90cd8ce8250d"} Jun 02 18:42:15.560461 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:15.560423 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd8f96-bvbgz" event={"ID":"0eb86db9-ef82-445a-9e9b-c2091cbd19f1","Type":"ContainerStarted","Data":"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7"} Jun 02 18:42:15.579614 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:15.579563 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-687dd8f96-bvbgz" podStartSLOduration=1.488663259 podStartE2EDuration="4.579549944s" podCreationTimestamp="2026-06-02 18:42:11 +0000 UTC" firstStartedPulling="2026-06-02 18:42:11.597203134 +0000 UTC m=+143.133031922" lastFinishedPulling="2026-06-02 18:42:14.688089816 +0000 UTC m=+146.223918607" observedRunningTime="2026-06-02 18:42:15.57753797 +0000 UTC m=+147.113366780" watchObservedRunningTime="2026-06-02 18:42:15.579549944 +0000 UTC m=+147.115378753" Jun 02 18:42:20.629224 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.629185 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw"] Jun 02 18:42:20.631200 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.631183 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.639994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639897 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 18:42:20.639994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639937 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 18:42:20.639994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639955 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v687t\"" Jun 02 18:42:20.639994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639899 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 18:42:20.639994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639967 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 18:42:20.640472 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639967 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 18:42:20.640472 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.639894 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 18:42:20.646637 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.646614 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw"] Jun 02 18:42:20.656450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.656426 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9g6cp"] Jun 02 18:42:20.658255 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.658236 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.660861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.660841 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 18:42:20.661148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.661131 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-68kzm\"" Jun 02 18:42:20.661210 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.661198 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 18:42:20.661277 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.661258 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 18:42:20.783453 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-tls\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783453 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-root\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-sys\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-textfile\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783827 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b67ab23-7a2a-469d-8968-191398d0d89c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783827 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783827 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh657\" (UniqueName: \"kubernetes.io/projected/653464cd-0d47-446e-9a33-5cd142b4fb67-kube-api-access-hh657\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783827 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-accelerators-collector-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783827 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-wtmp\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783970 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.783970 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783970 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb58x\" (UniqueName: \"kubernetes.io/projected/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-api-access-wb58x\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.783970 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.783915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-metrics-client-ca\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.884603 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884523 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.884603 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884561 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-textfile\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.884603 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884588 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b67ab23-7a2a-469d-8968-191398d0d89c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.884861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884614 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.884861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884646 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh657\" (UniqueName: \"kubernetes.io/projected/653464cd-0d47-446e-9a33-5cd142b4fb67-kube-api-access-hh657\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.884861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884677 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-accelerators-collector-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.884861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884701 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-wtmp\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.884861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884723 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-wtmp\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884944 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.885100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.884983 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb58x\" (UniqueName: \"kubernetes.io/projected/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-api-access-wb58x\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.885100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885012 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-metrics-client-ca\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-textfile\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b67ab23-7a2a-469d-8968-191398d0d89c-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885171 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-tls\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885203 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-root\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885246 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.885286 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885269 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-sys\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885544 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885307 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-root\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885544 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885333 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/653464cd-0d47-446e-9a33-5cd142b4fb67-sys\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885544 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-accelerators-collector-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.885652 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.885835 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.885812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/653464cd-0d47-446e-9a33-5cd142b4fb67-metrics-client-ca\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.886155 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.886132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b67ab23-7a2a-469d-8968-191398d0d89c-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.887284 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.887260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.887594 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.887574 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/653464cd-0d47-446e-9a33-5cd142b4fb67-node-exporter-tls\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.887730 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.887694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.887919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.887900 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.894533 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.894507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh657\" (UniqueName: \"kubernetes.io/projected/653464cd-0d47-446e-9a33-5cd142b4fb67-kube-api-access-hh657\") pod \"node-exporter-9g6cp\" (UID: \"653464cd-0d47-446e-9a33-5cd142b4fb67\") " pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.894795 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.894776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb58x\" (UniqueName: \"kubernetes.io/projected/8b67ab23-7a2a-469d-8968-191398d0d89c-kube-api-access-wb58x\") pod \"kube-state-metrics-8469c486bb-vfwvw\" (UID: \"8b67ab23-7a2a-469d-8968-191398d0d89c\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.939864 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.939828 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" Jun 02 18:42:20.966964 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:20.966931 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9g6cp" Jun 02 18:42:20.974631 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:20.974598 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653464cd_0d47_446e_9a33_5cd142b4fb67.slice/crio-bd9bd98469fb9db1ffd32b423a55503d224157de78f9bdabe35a649be309ce8e WatchSource:0}: Error finding container bd9bd98469fb9db1ffd32b423a55503d224157de78f9bdabe35a649be309ce8e: Status 404 returned error can't find the container with id bd9bd98469fb9db1ffd32b423a55503d224157de78f9bdabe35a649be309ce8e Jun 02 18:42:21.075536 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.075493 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw"] Jun 02 18:42:21.078299 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:21.078263 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b67ab23_7a2a_469d_8968_191398d0d89c.slice/crio-25e2eb9db20929d869fcc5c9e4819a19a9750002fe9c4b38b61e7b09e11f9347 WatchSource:0}: Error finding container 25e2eb9db20929d869fcc5c9e4819a19a9750002fe9c4b38b61e7b09e11f9347: Status 404 returned error can't find the container with id 25e2eb9db20929d869fcc5c9e4819a19a9750002fe9c4b38b61e7b09e11f9347 Jun 02 18:42:21.467540 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.467493 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:21.467540 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.467538 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:21.468916 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.468892 2564 patch_prober.go:28] interesting pod/console-687dd8f96-bvbgz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jun 02 18:42:21.469008 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.468933 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-687dd8f96-bvbgz" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jun 02 18:42:21.576390 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.576348 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" event={"ID":"8b67ab23-7a2a-469d-8968-191398d0d89c","Type":"ContainerStarted","Data":"25e2eb9db20929d869fcc5c9e4819a19a9750002fe9c4b38b61e7b09e11f9347"} Jun 02 18:42:21.577761 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:21.577710 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9g6cp" event={"ID":"653464cd-0d47-446e-9a33-5cd142b4fb67","Type":"ContainerStarted","Data":"bd9bd98469fb9db1ffd32b423a55503d224157de78f9bdabe35a649be309ce8e"} Jun 02 18:42:22.582591 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.582549 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" event={"ID":"8b67ab23-7a2a-469d-8968-191398d0d89c","Type":"ContainerStarted","Data":"440da4d0e6d60a632f7de64c06edbd82c049581a98a2918786d839af253b1a52"} Jun 02 18:42:22.582591 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.582595 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" event={"ID":"8b67ab23-7a2a-469d-8968-191398d0d89c","Type":"ContainerStarted","Data":"b79e21254ece4fb65293f5aca3032f893807fd766d163ce524a0c3dcd5c321ce"} Jun 02 18:42:22.583112 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.582610 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" event={"ID":"8b67ab23-7a2a-469d-8968-191398d0d89c","Type":"ContainerStarted","Data":"c56f8ce0e1c18609a831a89cb11a0c6f26343fe226a4d8f84a1752d608a371db"} Jun 02 18:42:22.584516 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.584481 2564 generic.go:358] "Generic (PLEG): container finished" podID="653464cd-0d47-446e-9a33-5cd142b4fb67" containerID="395d5e27c56f5608e7dfb530dcdb83942241c44d32c2b70e8bb32067b3a05f98" exitCode=0 Jun 02 18:42:22.584625 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.584569 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9g6cp" event={"ID":"653464cd-0d47-446e-9a33-5cd142b4fb67","Type":"ContainerDied","Data":"395d5e27c56f5608e7dfb530dcdb83942241c44d32c2b70e8bb32067b3a05f98"} Jun 02 18:42:22.602513 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:22.602432 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vfwvw" podStartSLOduration=1.32655907 podStartE2EDuration="2.602418881s" podCreationTimestamp="2026-06-02 18:42:20 +0000 UTC" firstStartedPulling="2026-06-02 18:42:21.080102692 +0000 UTC m=+152.615931480" lastFinishedPulling="2026-06-02 18:42:22.355962499 +0000 UTC m=+153.891791291" observedRunningTime="2026-06-02 18:42:22.600569383 +0000 UTC m=+154.136398232" watchObservedRunningTime="2026-06-02 18:42:22.602418881 +0000 UTC m=+154.138247691" Jun 02 18:42:23.589489 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.589449 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9g6cp" event={"ID":"653464cd-0d47-446e-9a33-5cd142b4fb67","Type":"ContainerStarted","Data":"7cbea163e75e7c38fa53d7c93759f1b901a3f39e9040c7f79c56c1a18f5f639e"} Jun 02 18:42:23.589941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.589784 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9g6cp" event={"ID":"653464cd-0d47-446e-9a33-5cd142b4fb67","Type":"ContainerStarted","Data":"058b5c82e58e04f0f4ccbb4fd5bf798896f2bd2fe4a0f28cf9f7c1d60b89992c"} Jun 02 18:42:23.600725 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.600701 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl"] Jun 02 18:42:23.604168 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.604152 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.606840 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.606806 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8vx89\"" Jun 02 18:42:23.606840 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.606825 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 18:42:23.606998 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.606953 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ime7ufci4qno\"" Jun 02 18:42:23.607057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.606965 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 18:42:23.607057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.607036 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 18:42:23.607155 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.607053 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 18:42:23.607377 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.607351 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 18:42:23.613468 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.613424 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9g6cp" podStartSLOduration=2.236346895 podStartE2EDuration="3.613413437s" podCreationTimestamp="2026-06-02 18:42:20 +0000 UTC" firstStartedPulling="2026-06-02 18:42:20.976213437 +0000 UTC m=+152.512042226" lastFinishedPulling="2026-06-02 18:42:22.353279971 +0000 UTC m=+153.889108768" observedRunningTime="2026-06-02 18:42:23.611927437 +0000 UTC m=+155.147756260" watchObservedRunningTime="2026-06-02 18:42:23.613413437 +0000 UTC m=+155.149242246" Jun 02 18:42:23.617086 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.617058 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl"] Jun 02 18:42:23.711595 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-grpc-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-metrics-client-ca\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711806 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711946 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.711946 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.711931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2g6\" (UniqueName: \"kubernetes.io/projected/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-kube-api-access-8s2g6\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.712073 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.712049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813103 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813059 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813103 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813109 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-grpc-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813139 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813164 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-metrics-client-ca\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813197 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813239 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813267 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2g6\" (UniqueName: \"kubernetes.io/projected/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-kube-api-access-8s2g6\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.813346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.813335 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.814293 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.814246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-metrics-client-ca\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816139 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816261 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816335 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816424 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816553 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.816689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.816672 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-secret-grpc-tls\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.821149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.821128 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2g6\" (UniqueName: \"kubernetes.io/projected/50bf3ef4-5a2b-45a4-94f1-e69585be16d9-kube-api-access-8s2g6\") pod \"thanos-querier-6cc79f4b54-kpsjl\" (UID: \"50bf3ef4-5a2b-45a4-94f1-e69585be16d9\") " pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:23.913693 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:23.913601 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:24.043192 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:24.043159 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl"] Jun 02 18:42:24.045969 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:24.045938 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bf3ef4_5a2b_45a4_94f1_e69585be16d9.slice/crio-9d3baeac0554e63ea7c8cf8de9e7a7738885f40fb4fb040bc56c5a66c25b58b4 WatchSource:0}: Error finding container 9d3baeac0554e63ea7c8cf8de9e7a7738885f40fb4fb040bc56c5a66c25b58b4: Status 404 returned error can't find the container with id 9d3baeac0554e63ea7c8cf8de9e7a7738885f40fb4fb040bc56c5a66c25b58b4 Jun 02 18:42:24.592316 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:24.592284 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"9d3baeac0554e63ea7c8cf8de9e7a7738885f40fb4fb040bc56c5a66c25b58b4"} Jun 02 18:42:25.121619 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.121585 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8bb89bf9-dxn5g"] Jun 02 18:42:25.126388 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.125288 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.128638 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.128619 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 18:42:25.128799 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.128620 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ljbzs\"" Jun 02 18:42:25.128799 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.128620 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 18:42:25.129974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.129953 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-60m1sbm1gqu8f\"" Jun 02 18:42:25.129974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.129969 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 18:42:25.130130 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.129987 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 18:42:25.133969 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.133923 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8bb89bf9-dxn5g"] Jun 02 18:42:25.227941 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.227898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvjb\" (UniqueName: \"kubernetes.io/projected/5cd98ba5-a27c-42f7-909b-100eac56e3f5-kube-api-access-pfvjb\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228125 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.227954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd98ba5-a27c-42f7-909b-100eac56e3f5-audit-log\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228188 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.228150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228238 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.228195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-client-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228238 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.228232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-metrics-server-audit-profiles\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228386 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.228269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-client-certs\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.228386 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.228285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-tls\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329220 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329274 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-client-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329593 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329301 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-metrics-server-audit-profiles\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329593 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329346 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-client-certs\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329593 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329370 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-tls\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329593 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329431 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvjb\" (UniqueName: \"kubernetes.io/projected/5cd98ba5-a27c-42f7-909b-100eac56e3f5-kube-api-access-pfvjb\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329593 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329464 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd98ba5-a27c-42f7-909b-100eac56e3f5-audit-log\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.329964 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.329941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5cd98ba5-a27c-42f7-909b-100eac56e3f5-audit-log\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.330138 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.330117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.330647 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.330624 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5cd98ba5-a27c-42f7-909b-100eac56e3f5-metrics-server-audit-profiles\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.332112 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.332090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-client-ca-bundle\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.332527 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.332508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-client-certs\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.332571 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.332536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5cd98ba5-a27c-42f7-909b-100eac56e3f5-secret-metrics-server-tls\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.338060 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.338037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvjb\" (UniqueName: \"kubernetes.io/projected/5cd98ba5-a27c-42f7-909b-100eac56e3f5-kube-api-access-pfvjb\") pod \"metrics-server-8bb89bf9-dxn5g\" (UID: \"5cd98ba5-a27c-42f7-909b-100eac56e3f5\") " pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.436702 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.436610 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:25.613434 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.613405 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8bb89bf9-dxn5g"] Jun 02 18:42:25.616488 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:25.616459 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd98ba5_a27c_42f7_909b_100eac56e3f5.slice/crio-a586afb2efb44cef7b8ddc8926cbde76f2f72573a0375894b4fa3c0465890fde WatchSource:0}: Error finding container a586afb2efb44cef7b8ddc8926cbde76f2f72573a0375894b4fa3c0465890fde: Status 404 returned error can't find the container with id a586afb2efb44cef7b8ddc8926cbde76f2f72573a0375894b4fa3c0465890fde Jun 02 18:42:25.973412 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:25.973377 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:26.002760 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.002704 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:42:26.006307 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.006283 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.015706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.015676 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 18:42:26.016649 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.016623 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:42:26.142289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142490 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142490 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142490 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.142586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.142559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvg6h\" (UniqueName: \"kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.243875 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.243779 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.243875 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.243860 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244090 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.243892 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244090 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.243912 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244378 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244347 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244514 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244410 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvg6h\" (UniqueName: \"kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244514 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244494 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244763 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.244867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.244834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.245470 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.245445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.246896 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.246873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.247216 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.247199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.253537 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.253517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvg6h\" (UniqueName: \"kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h\") pod \"console-57d8d45cd-4k5z7\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.317568 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.317530 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:26.358020 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:42:26.357985 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m5szk" podUID="8b757491-e6d2-4191-ad6d-cee837dbd02b" Jun 02 18:42:26.370355 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:42:26.370317 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8nx9h" podUID="4cb8dd1f-abce-4d90-804a-3b97495e745e" Jun 02 18:42:26.453308 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.453280 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:42:26.456576 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:26.456544 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8707a9_382c_4cf1_98af_ae891124f29d.slice/crio-34f4451f35fe1838938a82f661125800a37a8e9e06ba5a4895530d625c32ada7 WatchSource:0}: Error finding container 34f4451f35fe1838938a82f661125800a37a8e9e06ba5a4895530d625c32ada7: Status 404 returned error can't find the container with id 34f4451f35fe1838938a82f661125800a37a8e9e06ba5a4895530d625c32ada7 Jun 02 18:42:26.603721 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.603661 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" event={"ID":"5cd98ba5-a27c-42f7-909b-100eac56e3f5","Type":"ContainerStarted","Data":"a586afb2efb44cef7b8ddc8926cbde76f2f72573a0375894b4fa3c0465890fde"} Jun 02 18:42:26.605840 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.605761 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"510c4a5119d499c2c9d35f134d9f704fe745cad414a5d43684e9f8bdffd0cde5"} Jun 02 18:42:26.605840 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.605793 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"ba31e3957f0b7d2843ff78cee664097a32b7ee764df4988f710ff9fd2096d649"} Jun 02 18:42:26.605840 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.605808 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"c61d50fc419d98c2917dc94be0c581920768b48de8e623ebbabac79d46bc37b3"} Jun 02 18:42:26.607951 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.607449 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d45cd-4k5z7" event={"ID":"0c8707a9-382c-4cf1-98af-ae891124f29d","Type":"ContainerStarted","Data":"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f"} Jun 02 18:42:26.607951 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.607475 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d45cd-4k5z7" event={"ID":"0c8707a9-382c-4cf1-98af-ae891124f29d","Type":"ContainerStarted","Data":"34f4451f35fe1838938a82f661125800a37a8e9e06ba5a4895530d625c32ada7"} Jun 02 18:42:26.607951 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.607477 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:26.626983 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:26.626930 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57d8d45cd-4k5z7" podStartSLOduration=1.6269130939999998 podStartE2EDuration="1.626913094s" podCreationTimestamp="2026-06-02 18:42:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:42:26.626466387 +0000 UTC m=+158.162295200" watchObservedRunningTime="2026-06-02 18:42:26.626913094 +0000 UTC m=+158.162741904" Jun 02 18:42:27.611544 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:27.611432 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" event={"ID":"5cd98ba5-a27c-42f7-909b-100eac56e3f5","Type":"ContainerStarted","Data":"7326a41b0508e0134b63277c14ab9182343641659845fede1e6af6c2124023d8"} Jun 02 18:42:27.614084 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:27.614055 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"faa34dee8aa2d5f13f9a12e5a32e0ac4f006f434223909536c0c2d420c1f4615"} Jun 02 18:42:27.630065 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:27.630018 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" podStartSLOduration=0.750768545 podStartE2EDuration="2.630002454s" podCreationTimestamp="2026-06-02 18:42:25 +0000 UTC" firstStartedPulling="2026-06-02 18:42:25.619077455 +0000 UTC m=+157.154906248" lastFinishedPulling="2026-06-02 18:42:27.498311368 +0000 UTC m=+159.034140157" observedRunningTime="2026-06-02 18:42:27.627448944 +0000 UTC m=+159.163277767" watchObservedRunningTime="2026-06-02 18:42:27.630002454 +0000 UTC m=+159.165831258" Jun 02 18:42:28.619061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:28.619015 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"b6b59c095affdf40abc97748d4160b1138e03d70781c67ab22e69954a8310001"} Jun 02 18:42:28.619061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:28.619063 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" event={"ID":"50bf3ef4-5a2b-45a4-94f1-e69585be16d9","Type":"ContainerStarted","Data":"e2941ca4ca3338afff70e63c1a9d5ff48051fa5fa897fe6fb0ab56b4f41e7c0b"} Jun 02 18:42:28.645512 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:28.645460 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" podStartSLOduration=2.153848185 podStartE2EDuration="5.645443879s" podCreationTimestamp="2026-06-02 18:42:23 +0000 UTC" firstStartedPulling="2026-06-02 18:42:24.047827367 +0000 UTC m=+155.583656155" lastFinishedPulling="2026-06-02 18:42:27.539423044 +0000 UTC m=+159.075251849" observedRunningTime="2026-06-02 18:42:28.640950389 +0000 UTC m=+160.176779201" watchObservedRunningTime="2026-06-02 18:42:28.645443879 +0000 UTC m=+160.181272685" Jun 02 18:42:29.622191 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.622148 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:29.634416 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.634381 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:42:29.641076 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.641051 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.646999 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.646958 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:42:29.777996 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.777950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778198 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778343 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778343 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46cj\" (UniqueName: \"kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.778450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.778429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879389 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879296 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879389 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879379 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879403 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879428 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f46cj\" (UniqueName: \"kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879453 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879472 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.879607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.879493 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.880181 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.880152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.880267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.880189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.880267 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.880238 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.880395 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.880378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.882080 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.882061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.882139 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.882080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.887872 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.887851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46cj\" (UniqueName: \"kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj\") pod \"console-6d6879b878-x9rfn\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:29.950489 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:29.950454 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:30.075973 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:30.075941 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:42:30.079163 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:30.079135 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26d30c2_c082_4ba1_a3df_17cd6a234162.slice/crio-297678db04a2e6268b64bf62e0c2fe0d07afe19357016ae8d5214e9424b69b3c WatchSource:0}: Error finding container 297678db04a2e6268b64bf62e0c2fe0d07afe19357016ae8d5214e9424b69b3c: Status 404 returned error can't find the container with id 297678db04a2e6268b64bf62e0c2fe0d07afe19357016ae8d5214e9424b69b3c Jun 02 18:42:30.626726 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:30.626684 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6879b878-x9rfn" event={"ID":"c26d30c2-c082-4ba1-a3df-17cd6a234162","Type":"ContainerStarted","Data":"4a5efbc4dd3ce3ef91756a40f6347e74db0c88f3dab6cead3483224b02bc0e17"} Jun 02 18:42:30.626919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:30.626746 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6879b878-x9rfn" event={"ID":"c26d30c2-c082-4ba1-a3df-17cd6a234162","Type":"ContainerStarted","Data":"297678db04a2e6268b64bf62e0c2fe0d07afe19357016ae8d5214e9424b69b3c"} Jun 02 18:42:30.647035 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:30.646985 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d6879b878-x9rfn" podStartSLOduration=1.646970732 podStartE2EDuration="1.646970732s" podCreationTimestamp="2026-06-02 18:42:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:42:30.64320065 +0000 UTC m=+162.179029459" watchObservedRunningTime="2026-06-02 18:42:30.646970732 +0000 UTC m=+162.182799541" Jun 02 18:42:31.191804 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.191759 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:42:31.191991 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.191817 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:31.194402 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.194367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b757491-e6d2-4191-ad6d-cee837dbd02b-metrics-tls\") pod \"dns-default-m5szk\" (UID: \"8b757491-e6d2-4191-ad6d-cee837dbd02b\") " pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:31.194501 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.194413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cb8dd1f-abce-4d90-804a-3b97495e745e-cert\") pod \"ingress-canary-8nx9h\" (UID: \"4cb8dd1f-abce-4d90-804a-3b97495e745e\") " pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:42:31.411050 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.411017 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:42:31.418284 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.418264 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:31.542751 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.542701 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5szk"] Jun 02 18:42:31.545831 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:31.545803 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b757491_e6d2_4191_ad6d_cee837dbd02b.slice/crio-b23769b2bbb9b9d092861095e188b75aaec3b97909ebd92e119466a0aa1d709d WatchSource:0}: Error finding container b23769b2bbb9b9d092861095e188b75aaec3b97909ebd92e119466a0aa1d709d: Status 404 returned error can't find the container with id b23769b2bbb9b9d092861095e188b75aaec3b97909ebd92e119466a0aa1d709d Jun 02 18:42:31.563239 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.563205 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" podUID="368bed9d-2f40-4d8f-8a42-c0fd772289f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 18:42:31.630652 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:31.630614 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5szk" event={"ID":"8b757491-e6d2-4191-ad6d-cee837dbd02b","Type":"ContainerStarted","Data":"b23769b2bbb9b9d092861095e188b75aaec3b97909ebd92e119466a0aa1d709d"} Jun 02 18:42:33.642258 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:33.642222 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5szk" event={"ID":"8b757491-e6d2-4191-ad6d-cee837dbd02b","Type":"ContainerStarted","Data":"76a5d31697f48521c619dfa7b732b386eebfafd4cb3024de7e808101d77d4691"} Jun 02 18:42:33.642258 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:33.642258 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5szk" event={"ID":"8b757491-e6d2-4191-ad6d-cee837dbd02b","Type":"ContainerStarted","Data":"222abfab1cb31e2468bdb940452304b7d3d8c7bd0341dfa1a4a280f3e54df816"} Jun 02 18:42:33.642664 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:33.642383 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:33.660602 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:33.660552 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-m5szk" podStartSLOduration=129.530141919 podStartE2EDuration="2m10.660540027s" podCreationTimestamp="2026-06-02 18:40:23 +0000 UTC" firstStartedPulling="2026-06-02 18:42:31.547594044 +0000 UTC m=+163.083422834" lastFinishedPulling="2026-06-02 18:42:32.677992146 +0000 UTC m=+164.213820942" observedRunningTime="2026-06-02 18:42:33.65896542 +0000 UTC m=+165.194794245" watchObservedRunningTime="2026-06-02 18:42:33.660540027 +0000 UTC m=+165.196368894" Jun 02 18:42:35.632503 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:35.632475 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cc79f4b54-kpsjl" Jun 02 18:42:36.318447 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:36.318408 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:36.318596 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:36.318461 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:36.319623 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:36.319601 2564 patch_prober.go:28] interesting pod/console-57d8d45cd-4k5z7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 02 18:42:36.319695 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:36.319676 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57d8d45cd-4k5z7" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 02 18:42:39.084554 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.084507 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:42:39.087713 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.087690 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:42:39.095223 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.095206 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8nx9h" Jun 02 18:42:39.221604 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.221575 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8nx9h"] Jun 02 18:42:39.224167 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:42:39.224135 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb8dd1f_abce_4d90_804a_3b97495e745e.slice/crio-f652afa767a313cd3ba518cfcb16b2aebf841a6dbc8da8304b70efb97b1efaeb WatchSource:0}: Error finding container f652afa767a313cd3ba518cfcb16b2aebf841a6dbc8da8304b70efb97b1efaeb: Status 404 returned error can't find the container with id f652afa767a313cd3ba518cfcb16b2aebf841a6dbc8da8304b70efb97b1efaeb Jun 02 18:42:39.659240 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.659194 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8nx9h" event={"ID":"4cb8dd1f-abce-4d90-804a-3b97495e745e","Type":"ContainerStarted","Data":"f652afa767a313cd3ba518cfcb16b2aebf841a6dbc8da8304b70efb97b1efaeb"} Jun 02 18:42:39.951505 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.951414 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:39.951505 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.951460 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:39.953099 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.953064 2564 patch_prober.go:28] interesting pod/console-6d6879b878-x9rfn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 02 18:42:39.953203 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:39.953126 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d6879b878-x9rfn" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 02 18:42:41.563457 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:41.563421 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" podUID="368bed9d-2f40-4d8f-8a42-c0fd772289f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 18:42:41.667274 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:41.667239 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8nx9h" event={"ID":"4cb8dd1f-abce-4d90-804a-3b97495e745e","Type":"ContainerStarted","Data":"b26efa8eaf1007917591ab95949074c443862f8c3dea70348cec861737d81243"} Jun 02 18:42:41.683425 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:41.683375 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8nx9h" podStartSLOduration=137.133356107 podStartE2EDuration="2m18.683360514s" podCreationTimestamp="2026-06-02 18:40:23 +0000 UTC" firstStartedPulling="2026-06-02 18:42:39.226594288 +0000 UTC m=+170.762423076" lastFinishedPulling="2026-06-02 18:42:40.776598491 +0000 UTC m=+172.312427483" observedRunningTime="2026-06-02 18:42:41.682185302 +0000 UTC m=+173.218014113" watchObservedRunningTime="2026-06-02 18:42:41.683360514 +0000 UTC m=+173.219189323" Jun 02 18:42:43.647797 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:43.647760 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m5szk" Jun 02 18:42:45.437481 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:45.437445 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:45.437919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:45.437515 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:42:46.322528 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:46.322492 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:46.326569 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:46.326545 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:42:49.954883 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:49.954852 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:49.958750 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:49.958716 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:42:50.025331 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:50.025298 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:42:50.997014 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:50.996950 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-687dd8f96-bvbgz" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerName="console" containerID="cri-o://53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7" gracePeriod=15 Jun 02 18:42:51.240098 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.240075 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-687dd8f96-bvbgz_0eb86db9-ef82-445a-9e9b-c2091cbd19f1/console/0.log" Jun 02 18:42:51.240229 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.240164 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:51.354168 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354139 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf8hh\" (UniqueName: \"kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354189 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354207 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354230 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354249 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354287 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca\") pod \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\" (UID: \"0eb86db9-ef82-445a-9e9b-c2091cbd19f1\") " Jun 02 18:42:51.354686 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354637 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config" (OuterVolumeSpecName: "console-config") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:51.354855 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354765 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:51.354855 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.354804 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:51.356644 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.356621 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:51.357021 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.356996 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:51.357111 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.357020 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh" (OuterVolumeSpecName: "kube-api-access-pf8hh") pod "0eb86db9-ef82-445a-9e9b-c2091cbd19f1" (UID: "0eb86db9-ef82-445a-9e9b-c2091cbd19f1"). InnerVolumeSpecName "kube-api-access-pf8hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:42:51.455844 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455793 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf8hh\" (UniqueName: \"kubernetes.io/projected/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-kube-api-access-pf8hh\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.455844 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455838 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.455844 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455850 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.455844 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455860 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-oauth-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.456109 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455869 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-console-oauth-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.456109 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.455878 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eb86db9-ef82-445a-9e9b-c2091cbd19f1-service-ca\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:42:51.563779 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.563715 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" podUID="368bed9d-2f40-4d8f-8a42-c0fd772289f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 18:42:51.563916 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.563811 2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" Jun 02 18:42:51.564292 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.564262 2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5a97abf517297684f418e53a87b5332ca5b8c3c6b47f062831bbc3c30a2f8b5a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 18:42:51.564348 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.564312 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" podUID="368bed9d-2f40-4d8f-8a42-c0fd772289f9" containerName="service-proxy" containerID="cri-o://5a97abf517297684f418e53a87b5332ca5b8c3c6b47f062831bbc3c30a2f8b5a" gracePeriod=30 Jun 02 18:42:51.695923 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.695901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-687dd8f96-bvbgz_0eb86db9-ef82-445a-9e9b-c2091cbd19f1/console/0.log" Jun 02 18:42:51.696024 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.695939 2564 generic.go:358] "Generic (PLEG): container finished" podID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerID="53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7" exitCode=2 Jun 02 18:42:51.696024 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.695999 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd8f96-bvbgz" Jun 02 18:42:51.696024 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.696005 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd8f96-bvbgz" event={"ID":"0eb86db9-ef82-445a-9e9b-c2091cbd19f1","Type":"ContainerDied","Data":"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7"} Jun 02 18:42:51.696181 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.696030 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd8f96-bvbgz" event={"ID":"0eb86db9-ef82-445a-9e9b-c2091cbd19f1","Type":"ContainerDied","Data":"f230261aa7fca6298fb6bd2c800a0ea5dfec31b82df7865a5fdf90cd8ce8250d"} Jun 02 18:42:51.696181 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.696044 2564 scope.go:117] "RemoveContainer" containerID="53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7" Jun 02 18:42:51.698186 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.698119 2564 generic.go:358] "Generic (PLEG): container finished" podID="368bed9d-2f40-4d8f-8a42-c0fd772289f9" containerID="5a97abf517297684f418e53a87b5332ca5b8c3c6b47f062831bbc3c30a2f8b5a" exitCode=2 Jun 02 18:42:51.698261 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.698217 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerDied","Data":"5a97abf517297684f418e53a87b5332ca5b8c3c6b47f062831bbc3c30a2f8b5a"} Jun 02 18:42:51.704959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.704935 2564 scope.go:117] "RemoveContainer" containerID="53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7" Jun 02 18:42:51.705221 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:42:51.705202 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7\": container with ID starting with 53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7 not found: ID does not exist" containerID="53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7" Jun 02 18:42:51.705276 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.705231 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7"} err="failed to get container status \"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7\": rpc error: code = NotFound desc = could not find container \"53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7\": container with ID starting with 53fd5086e75027e698d661930739f89f7c728dc260547c5a6c8e2dcafcf334e7 not found: ID does not exist" Jun 02 18:42:51.718690 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.718656 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:51.721856 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:51.721835 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687dd8f96-bvbgz"] Jun 02 18:42:52.704187 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:52.704153 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bc9c946d7-ht966" event={"ID":"368bed9d-2f40-4d8f-8a42-c0fd772289f9","Type":"ContainerStarted","Data":"32cb3f4a8b5caef67390c804062b0d509df32d8f59f293a38038b0a7762b9e55"} Jun 02 18:42:53.084891 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:42:53.084860 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" path="/var/lib/kubelet/pods/0eb86db9-ef82-445a-9e9b-c2091cbd19f1/volumes" Jun 02 18:43:05.442082 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:05.442049 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:43:05.446040 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:05.446016 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8bb89bf9-dxn5g" Jun 02 18:43:15.045980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.045917 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57d8d45cd-4k5z7" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerName="console" containerID="cri-o://6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f" gracePeriod=15 Jun 02 18:43:15.311772 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.311731 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d8d45cd-4k5z7_0c8707a9-382c-4cf1-98af-ae891124f29d/console/0.log" Jun 02 18:43:15.311939 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.311809 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:43:15.456683 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456645 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456683 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456684 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456712 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456783 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456816 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvg6h\" (UniqueName: \"kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456863 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.456974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.456907 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert\") pod \"0c8707a9-382c-4cf1-98af-ae891124f29d\" (UID: \"0c8707a9-382c-4cf1-98af-ae891124f29d\") " Jun 02 18:43:15.457210 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.457068 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config" (OuterVolumeSpecName: "console-config") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:15.457210 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.457104 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:15.457210 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.457165 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-console-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.457352 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.457295 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:15.457406 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.457362 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:15.459305 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.459272 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:43:15.459604 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.459575 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:43:15.459685 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.459626 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h" (OuterVolumeSpecName: "kube-api-access-cvg6h") pod "0c8707a9-382c-4cf1-98af-ae891124f29d" (UID: "0c8707a9-382c-4cf1-98af-ae891124f29d"). InnerVolumeSpecName "kube-api-access-cvg6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558346 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-oauth-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558389 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-service-ca\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558404 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558418 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c8707a9-382c-4cf1-98af-ae891124f29d-console-oauth-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558432 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvg6h\" (UniqueName: \"kubernetes.io/projected/0c8707a9-382c-4cf1-98af-ae891124f29d-kube-api-access-cvg6h\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.558442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.558446 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c8707a9-382c-4cf1-98af-ae891124f29d-trusted-ca-bundle\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:43:15.772102 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772077 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d8d45cd-4k5z7_0c8707a9-382c-4cf1-98af-ae891124f29d/console/0.log" Jun 02 18:43:15.772271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772116 2564 generic.go:358] "Generic (PLEG): container finished" podID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerID="6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f" exitCode=2 Jun 02 18:43:15.772271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772170 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d45cd-4k5z7" event={"ID":"0c8707a9-382c-4cf1-98af-ae891124f29d","Type":"ContainerDied","Data":"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f"} Jun 02 18:43:15.772271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772193 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d8d45cd-4k5z7" event={"ID":"0c8707a9-382c-4cf1-98af-ae891124f29d","Type":"ContainerDied","Data":"34f4451f35fe1838938a82f661125800a37a8e9e06ba5a4895530d625c32ada7"} Jun 02 18:43:15.772271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772194 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d8d45cd-4k5z7" Jun 02 18:43:15.772271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.772211 2564 scope.go:117] "RemoveContainer" containerID="6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f" Jun 02 18:43:15.781727 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.781709 2564 scope.go:117] "RemoveContainer" containerID="6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f" Jun 02 18:43:15.782019 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:43:15.782002 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f\": container with ID starting with 6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f not found: ID does not exist" containerID="6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f" Jun 02 18:43:15.782068 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.782027 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f"} err="failed to get container status \"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f\": rpc error: code = NotFound desc = could not find container \"6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f\": container with ID starting with 6480f431f67f824a89e9c84bb61a5cc2cb122e122b81b2ca8c8831ed92f4006f not found: ID does not exist" Jun 02 18:43:15.793960 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.793932 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:43:15.797894 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:15.797852 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57d8d45cd-4k5z7"] Jun 02 18:43:17.084056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:43:17.084017 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" path="/var/lib/kubelet/pods/0c8707a9-382c-4cf1-98af-ae891124f29d/volumes" Jun 02 18:44:01.817497 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:01.817417 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:44:08.283541 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283505 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rqdpc"] Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283786 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerName="console" Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283798 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerName="console" Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283810 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerName="console" Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283815 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerName="console" Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283856 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0eb86db9-ef82-445a-9e9b-c2091cbd19f1" containerName="console" Jun 02 18:44:08.283959 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.283866 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c8707a9-382c-4cf1-98af-ae891124f29d" containerName="console" Jun 02 18:44:08.286692 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.286672 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.289431 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.289410 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 18:44:08.295217 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.295192 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqdpc"] Jun 02 18:44:08.353046 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.353005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/870bf59a-2027-4784-9c35-304abb350c2c-original-pull-secret\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.353224 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.353063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-dbus\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.353224 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.353084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-kubelet-config\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.453435 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.453395 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/870bf59a-2027-4784-9c35-304abb350c2c-original-pull-secret\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.453584 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.453457 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-dbus\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.453584 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.453486 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-kubelet-config\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.453659 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.453582 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-kubelet-config\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.453704 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.453655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/870bf59a-2027-4784-9c35-304abb350c2c-dbus\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.455874 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.455849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/870bf59a-2027-4784-9c35-304abb350c2c-original-pull-secret\") pod \"global-pull-secret-syncer-rqdpc\" (UID: \"870bf59a-2027-4784-9c35-304abb350c2c\") " pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.596371 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.596261 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rqdpc" Jun 02 18:44:08.723910 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.723724 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rqdpc"] Jun 02 18:44:08.726539 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:44:08.726512 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870bf59a_2027_4784_9c35_304abb350c2c.slice/crio-3825dba2dba64dbb460626a598cb40ce7ed6a048478f5a2ef98b6e4f66af1383 WatchSource:0}: Error finding container 3825dba2dba64dbb460626a598cb40ce7ed6a048478f5a2ef98b6e4f66af1383: Status 404 returned error can't find the container with id 3825dba2dba64dbb460626a598cb40ce7ed6a048478f5a2ef98b6e4f66af1383 Jun 02 18:44:08.913280 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:08.913180 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqdpc" event={"ID":"870bf59a-2027-4784-9c35-304abb350c2c","Type":"ContainerStarted","Data":"3825dba2dba64dbb460626a598cb40ce7ed6a048478f5a2ef98b6e4f66af1383"} Jun 02 18:44:14.930384 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:14.930342 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rqdpc" event={"ID":"870bf59a-2027-4784-9c35-304abb350c2c","Type":"ContainerStarted","Data":"66ab0dd66e53614c9f7616a7ff27d1a1485a0734ea67d766f375e111e9c62c6a"} Jun 02 18:44:14.946547 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:14.946482 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rqdpc" podStartSLOduration=1.155461256 podStartE2EDuration="6.946469763s" podCreationTimestamp="2026-06-02 18:44:08 +0000 UTC" firstStartedPulling="2026-06-02 18:44:08.728191681 +0000 UTC m=+260.264020472" lastFinishedPulling="2026-06-02 18:44:14.519200191 +0000 UTC m=+266.055028979" observedRunningTime="2026-06-02 18:44:14.945650687 +0000 UTC m=+266.481479496" watchObservedRunningTime="2026-06-02 18:44:14.946469763 +0000 UTC m=+266.482298573" Jun 02 18:44:26.837221 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:26.837158 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d6879b878-x9rfn" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerName="console" containerID="cri-o://4a5efbc4dd3ce3ef91756a40f6347e74db0c88f3dab6cead3483224b02bc0e17" gracePeriod=15 Jun 02 18:44:26.967614 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:26.967404 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6879b878-x9rfn_c26d30c2-c082-4ba1-a3df-17cd6a234162/console/0.log" Jun 02 18:44:26.967614 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:26.967458 2564 generic.go:358] "Generic (PLEG): container finished" podID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerID="4a5efbc4dd3ce3ef91756a40f6347e74db0c88f3dab6cead3483224b02bc0e17" exitCode=2 Jun 02 18:44:26.967614 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:26.967538 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6879b878-x9rfn" event={"ID":"c26d30c2-c082-4ba1-a3df-17cd6a234162","Type":"ContainerDied","Data":"4a5efbc4dd3ce3ef91756a40f6347e74db0c88f3dab6cead3483224b02bc0e17"} Jun 02 18:44:27.078357 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.078334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6879b878-x9rfn_c26d30c2-c082-4ba1-a3df-17cd6a234162/console/0.log" Jun 02 18:44:27.078481 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.078400 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:44:27.205337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205245 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205299 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f46cj\" (UniqueName: \"kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205337 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205341 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205588 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205377 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205588 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205393 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205588 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205417 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205588 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205449 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca\") pod \"c26d30c2-c082-4ba1-a3df-17cd6a234162\" (UID: \"c26d30c2-c082-4ba1-a3df-17cd6a234162\") " Jun 02 18:44:27.205803 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205768 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:44:27.205967 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205940 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:44:27.205967 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205961 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca" (OuterVolumeSpecName: "service-ca") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:44:27.206117 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.205956 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config" (OuterVolumeSpecName: "console-config") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:44:27.207837 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.207796 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:44:27.207944 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.207888 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj" (OuterVolumeSpecName: "kube-api-access-f46cj") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "kube-api-access-f46cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:44:27.207944 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.207905 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c26d30c2-c082-4ba1-a3df-17cd6a234162" (UID: "c26d30c2-c082-4ba1-a3df-17cd6a234162"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:44:27.306115 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306076 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306115 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306108 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306115 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306120 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c26d30c2-c082-4ba1-a3df-17cd6a234162-console-oauth-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306129 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-service-ca\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306139 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-trusted-ca-bundle\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306147 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f46cj\" (UniqueName: \"kubernetes.io/projected/c26d30c2-c082-4ba1-a3df-17cd6a234162-kube-api-access-f46cj\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.306346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.306156 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c26d30c2-c082-4ba1-a3df-17cd6a234162-oauth-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:44:27.970951 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.970928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6879b878-x9rfn_c26d30c2-c082-4ba1-a3df-17cd6a234162/console/0.log" Jun 02 18:44:27.971329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.970992 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6879b878-x9rfn" event={"ID":"c26d30c2-c082-4ba1-a3df-17cd6a234162","Type":"ContainerDied","Data":"297678db04a2e6268b64bf62e0c2fe0d07afe19357016ae8d5214e9424b69b3c"} Jun 02 18:44:27.971329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.971028 2564 scope.go:117] "RemoveContainer" containerID="4a5efbc4dd3ce3ef91756a40f6347e74db0c88f3dab6cead3483224b02bc0e17" Jun 02 18:44:27.971329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.971035 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6879b878-x9rfn" Jun 02 18:44:27.992103 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.992072 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:44:27.994384 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:27.994359 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6879b878-x9rfn"] Jun 02 18:44:29.083610 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:29.083574 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" path="/var/lib/kubelet/pods/c26d30c2-c082-4ba1-a3df-17cd6a234162/volumes" Jun 02 18:44:49.011329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:44:49.011303 2564 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 18:45:07.591099 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.591059 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg"] Jun 02 18:45:07.593484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.591312 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerName="console" Jun 02 18:45:07.593484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.591323 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerName="console" Jun 02 18:45:07.593484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.591391 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c26d30c2-c082-4ba1-a3df-17cd6a234162" containerName="console" Jun 02 18:45:07.594402 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.594383 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.598569 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.598547 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 18:45:07.598686 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.598630 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:45:07.599052 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.599035 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nljzc\"" Jun 02 18:45:07.606633 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.606609 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg"] Jun 02 18:45:07.711982 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.711937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnk96\" (UniqueName: \"kubernetes.io/projected/b0285ae7-f7c7-4989-b7c3-d94930824df5-kube-api-access-bnk96\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.712169 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.712116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0285ae7-f7c7-4989-b7c3-d94930824df5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.812529 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.812491 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0285ae7-f7c7-4989-b7c3-d94930824df5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.812529 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.812530 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnk96\" (UniqueName: \"kubernetes.io/projected/b0285ae7-f7c7-4989-b7c3-d94930824df5-kube-api-access-bnk96\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.812915 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.812895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0285ae7-f7c7-4989-b7c3-d94930824df5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.821166 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.821141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnk96\" (UniqueName: \"kubernetes.io/projected/b0285ae7-f7c7-4989-b7c3-d94930824df5-kube-api-access-bnk96\") pod \"cert-manager-operator-controller-manager-54b9655956-qrgcg\" (UID: \"b0285ae7-f7c7-4989-b7c3-d94930824df5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:07.904202 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:07.904104 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" Jun 02 18:45:08.040623 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:08.040567 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg"] Jun 02 18:45:08.044254 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:45:08.044225 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0285ae7_f7c7_4989_b7c3_d94930824df5.slice/crio-a0503d06c4e7ed61570529afeeb14275d98d15d7a1e7afc9e0fbcadf6e394ca8 WatchSource:0}: Error finding container a0503d06c4e7ed61570529afeeb14275d98d15d7a1e7afc9e0fbcadf6e394ca8: Status 404 returned error can't find the container with id a0503d06c4e7ed61570529afeeb14275d98d15d7a1e7afc9e0fbcadf6e394ca8 Jun 02 18:45:08.047121 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:08.047101 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:45:08.081936 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:08.081901 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" event={"ID":"b0285ae7-f7c7-4989-b7c3-d94930824df5","Type":"ContainerStarted","Data":"a0503d06c4e7ed61570529afeeb14275d98d15d7a1e7afc9e0fbcadf6e394ca8"} Jun 02 18:45:11.093061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:11.093021 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" event={"ID":"b0285ae7-f7c7-4989-b7c3-d94930824df5","Type":"ContainerStarted","Data":"0e8d6ed049ed83e0cc59672b1c43bb456101f4036c9a7d1d10266adb76e1d447"} Jun 02 18:45:11.116510 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:11.116458 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qrgcg" podStartSLOduration=1.654239976 podStartE2EDuration="4.116441411s" podCreationTimestamp="2026-06-02 18:45:07 +0000 UTC" firstStartedPulling="2026-06-02 18:45:08.047301108 +0000 UTC m=+319.583129896" lastFinishedPulling="2026-06-02 18:45:10.50950254 +0000 UTC m=+322.045331331" observedRunningTime="2026-06-02 18:45:11.114185078 +0000 UTC m=+322.650013891" watchObservedRunningTime="2026-06-02 18:45:11.116441411 +0000 UTC m=+322.652270220" Jun 02 18:45:25.718893 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.718855 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k"] Jun 02 18:45:25.721769 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.721751 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.724488 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.724461 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:45:25.725789 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.725768 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xbmr6\"" Jun 02 18:45:25.725789 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.725784 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 18:45:25.729997 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.729961 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k"] Jun 02 18:45:25.739367 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.739331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.739499 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.739444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrh7\" (UniqueName: \"kubernetes.io/projected/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-kube-api-access-cqrh7\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.840862 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.840813 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrh7\" (UniqueName: \"kubernetes.io/projected/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-kube-api-access-cqrh7\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.841040 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.840884 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.841187 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.841173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-tmp\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:25.850322 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:25.850291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrh7\" (UniqueName: \"kubernetes.io/projected/9d41cac3-00e8-41e6-bc47-f88f7edf25f7-kube-api-access-cqrh7\") pod \"openshift-lws-operator-bfc7f696d-dbc4k\" (UID: \"9d41cac3-00e8-41e6-bc47-f88f7edf25f7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:26.031580 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:26.031545 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" Jun 02 18:45:26.157867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:26.157791 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k"] Jun 02 18:45:26.160646 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:45:26.160620 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d41cac3_00e8_41e6_bc47_f88f7edf25f7.slice/crio-32117004620d7d51d4fd57fde296f4f0b3972fb148aeddcd5b02d17b6546a607 WatchSource:0}: Error finding container 32117004620d7d51d4fd57fde296f4f0b3972fb148aeddcd5b02d17b6546a607: Status 404 returned error can't find the container with id 32117004620d7d51d4fd57fde296f4f0b3972fb148aeddcd5b02d17b6546a607 Jun 02 18:45:27.137509 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:27.137471 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" event={"ID":"9d41cac3-00e8-41e6-bc47-f88f7edf25f7","Type":"ContainerStarted","Data":"32117004620d7d51d4fd57fde296f4f0b3972fb148aeddcd5b02d17b6546a607"} Jun 02 18:45:29.145263 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:29.145177 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" event={"ID":"9d41cac3-00e8-41e6-bc47-f88f7edf25f7","Type":"ContainerStarted","Data":"c065e81b32477a37b7e948e80555b8fe02bf448897c807b978008342cfd0f455"} Jun 02 18:45:29.161175 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:29.161121 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dbc4k" podStartSLOduration=1.409883062 podStartE2EDuration="4.161108213s" podCreationTimestamp="2026-06-02 18:45:25 +0000 UTC" firstStartedPulling="2026-06-02 18:45:26.16229025 +0000 UTC m=+337.698119044" lastFinishedPulling="2026-06-02 18:45:28.913515405 +0000 UTC m=+340.449344195" observedRunningTime="2026-06-02 18:45:29.159697948 +0000 UTC m=+340.695526760" watchObservedRunningTime="2026-06-02 18:45:29.161108213 +0000 UTC m=+340.696937023" Jun 02 18:45:45.177354 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.177319 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2"] Jun 02 18:45:45.184082 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.184061 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.186695 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.186672 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 18:45:45.187223 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.187205 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-795jw\"" Jun 02 18:45:45.187333 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.187316 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 18:45:45.187831 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.187806 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 18:45:45.187890 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.187806 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 18:45:45.199180 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.199158 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2"] Jun 02 18:45:45.293362 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.293321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.293535 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.293373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.293535 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.293462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp4cb\" (UniqueName: \"kubernetes.io/projected/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-kube-api-access-gp4cb\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.293535 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.293508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.293670 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.293539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.394653 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.394617 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.394653 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.394654 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.394910 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.394684 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4cb\" (UniqueName: \"kubernetes.io/projected/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-kube-api-access-gp4cb\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.394910 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.394710 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.394910 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.394727 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.395270 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.395240 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.397237 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.397217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.397473 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.397451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.397520 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.397506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.408624 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.408601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4cb\" (UniqueName: \"kubernetes.io/projected/a7b74e3d-7cb3-47c5-b867-7c46f050e0c0-kube-api-access-gp4cb\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-nhwd2\" (UID: \"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.494340 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.494245 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:45.631123 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:45.631085 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2"] Jun 02 18:45:45.634612 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:45:45.634582 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b74e3d_7cb3_47c5_b867_7c46f050e0c0.slice/crio-46ba445b3ae285217cdb76bc31170ba91428b4e35cdd3d11d8e24875915b60d0 WatchSource:0}: Error finding container 46ba445b3ae285217cdb76bc31170ba91428b4e35cdd3d11d8e24875915b60d0: Status 404 returned error can't find the container with id 46ba445b3ae285217cdb76bc31170ba91428b4e35cdd3d11d8e24875915b60d0 Jun 02 18:45:46.199782 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:46.199723 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" event={"ID":"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0","Type":"ContainerStarted","Data":"46ba445b3ae285217cdb76bc31170ba91428b4e35cdd3d11d8e24875915b60d0"} Jun 02 18:45:49.211960 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:49.211921 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" event={"ID":"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0","Type":"ContainerStarted","Data":"be0acdb8330e4ffb91d53b163ff62189c26497c46c88b0570ed1f8d4f1d1bd1e"} Jun 02 18:45:50.216051 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:50.216014 2564 generic.go:358] "Generic (PLEG): container finished" podID="a7b74e3d-7cb3-47c5-b867-7c46f050e0c0" containerID="be0acdb8330e4ffb91d53b163ff62189c26497c46c88b0570ed1f8d4f1d1bd1e" exitCode=0 Jun 02 18:45:50.216448 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:50.216066 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" event={"ID":"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0","Type":"ContainerDied","Data":"be0acdb8330e4ffb91d53b163ff62189c26497c46c88b0570ed1f8d4f1d1bd1e"} Jun 02 18:45:51.220457 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:51.220419 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" event={"ID":"a7b74e3d-7cb3-47c5-b867-7c46f050e0c0","Type":"ContainerStarted","Data":"ac11e3b1e12f95938bc2b5e127ad9448b5128ba35655c29385fff3b83f0c1917"} Jun 02 18:45:51.220844 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:51.220559 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:45:51.244335 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:45:51.244285 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" podStartSLOduration=1.386719523 podStartE2EDuration="6.24426941s" podCreationTimestamp="2026-06-02 18:45:45 +0000 UTC" firstStartedPulling="2026-06-02 18:45:45.636335958 +0000 UTC m=+357.172164747" lastFinishedPulling="2026-06-02 18:45:50.49388583 +0000 UTC m=+362.029714634" observedRunningTime="2026-06-02 18:45:51.243025017 +0000 UTC m=+362.778853856" watchObservedRunningTime="2026-06-02 18:45:51.24426941 +0000 UTC m=+362.780098215" Jun 02 18:46:02.225825 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:02.225794 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-nhwd2" Jun 02 18:46:04.633102 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.633064 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j"] Jun 02 18:46:04.636456 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.636440 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.639022 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.638997 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 18:46:04.640493 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.640474 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 18:46:04.640618 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.640516 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7jjcv\"" Jun 02 18:46:04.640618 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.640528 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 18:46:04.640979 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.640964 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 18:46:04.648672 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.648651 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j"] Jun 02 18:46:04.673333 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.673290 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-x87qh"] Jun 02 18:46:04.677454 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.677432 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.680208 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.680187 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 18:46:04.680386 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.680367 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dv4sh\"" Jun 02 18:46:04.692849 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.692813 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-x87qh"] Jun 02 18:46:04.756404 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.756367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13af72a-3842-48d3-88ae-58142362ec2f-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.756404 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.756405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6z2\" (UniqueName: \"kubernetes.io/projected/e13af72a-3842-48d3-88ae-58142362ec2f-kube-api-access-hg6z2\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.756609 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.756478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d29a75-dc25-4d10-a335-30f383a7303e-cert\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.756609 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.756524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj68b\" (UniqueName: \"kubernetes.io/projected/60d29a75-dc25-4d10-a335-30f383a7303e-kube-api-access-rj68b\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.756609 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.756560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13af72a-3842-48d3-88ae-58142362ec2f-tmp\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.857535 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.857495 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d29a75-dc25-4d10-a335-30f383a7303e-cert\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.857729 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.857542 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rj68b\" (UniqueName: \"kubernetes.io/projected/60d29a75-dc25-4d10-a335-30f383a7303e-kube-api-access-rj68b\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.857729 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.857572 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13af72a-3842-48d3-88ae-58142362ec2f-tmp\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.857729 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.857608 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13af72a-3842-48d3-88ae-58142362ec2f-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.857729 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.857626 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6z2\" (UniqueName: \"kubernetes.io/projected/e13af72a-3842-48d3-88ae-58142362ec2f-kube-api-access-hg6z2\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.860459 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.860434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13af72a-3842-48d3-88ae-58142362ec2f-tmp\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.860614 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.860596 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60d29a75-dc25-4d10-a335-30f383a7303e-cert\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.860772 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.860724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13af72a-3842-48d3-88ae-58142362ec2f-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.870238 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.870213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6z2\" (UniqueName: \"kubernetes.io/projected/e13af72a-3842-48d3-88ae-58142362ec2f-kube-api-access-hg6z2\") pod \"kube-auth-proxy-7d6c8b7568-grv6j\" (UID: \"e13af72a-3842-48d3-88ae-58142362ec2f\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.870334 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.870315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj68b\" (UniqueName: \"kubernetes.io/projected/60d29a75-dc25-4d10-a335-30f383a7303e-kube-api-access-rj68b\") pod \"odh-model-controller-76588b95-x87qh\" (UID: \"60d29a75-dc25-4d10-a335-30f383a7303e\") " pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:04.946241 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.946153 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" Jun 02 18:46:04.988343 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:04.988306 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:05.093682 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.093659 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j"] Jun 02 18:46:05.095392 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:05.095363 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13af72a_3842_48d3_88ae_58142362ec2f.slice/crio-c0160ee940bb1c317c079ee2900130a0d42043201156d6d3281b15b5ecbaeb24 WatchSource:0}: Error finding container c0160ee940bb1c317c079ee2900130a0d42043201156d6d3281b15b5ecbaeb24: Status 404 returned error can't find the container with id c0160ee940bb1c317c079ee2900130a0d42043201156d6d3281b15b5ecbaeb24 Jun 02 18:46:05.138323 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.138288 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-x87qh"] Jun 02 18:46:05.141472 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:05.141437 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d29a75_dc25_4d10_a335_30f383a7303e.slice/crio-2c749ab72ffb7b6e6c2ff8bb475692037d033d44d69ecbf791043ed65f08babb WatchSource:0}: Error finding container 2c749ab72ffb7b6e6c2ff8bb475692037d033d44d69ecbf791043ed65f08babb: Status 404 returned error can't find the container with id 2c749ab72ffb7b6e6c2ff8bb475692037d033d44d69ecbf791043ed65f08babb Jun 02 18:46:05.265952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.265846 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-x87qh" event={"ID":"60d29a75-dc25-4d10-a335-30f383a7303e","Type":"ContainerStarted","Data":"2c749ab72ffb7b6e6c2ff8bb475692037d033d44d69ecbf791043ed65f08babb"} Jun 02 18:46:05.266793 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.266749 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" event={"ID":"e13af72a-3842-48d3-88ae-58142362ec2f","Type":"ContainerStarted","Data":"c0160ee940bb1c317c079ee2900130a0d42043201156d6d3281b15b5ecbaeb24"} Jun 02 18:46:05.541142 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.541106 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4vpfr"] Jun 02 18:46:05.544843 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.544803 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.548973 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.548951 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 18:46:05.549109 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.548953 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-h2xgk\"" Jun 02 18:46:05.561932 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.561884 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4vpfr"] Jun 02 18:46:05.663852 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.663810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2316de-313e-4aab-9b70-131a315cfb3c-tls-certs\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.664317 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.663888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzjr\" (UniqueName: \"kubernetes.io/projected/7d2316de-313e-4aab-9b70-131a315cfb3c-kube-api-access-gwzjr\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.765162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.765122 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2316de-313e-4aab-9b70-131a315cfb3c-tls-certs\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.765353 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.765209 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzjr\" (UniqueName: \"kubernetes.io/projected/7d2316de-313e-4aab-9b70-131a315cfb3c-kube-api-access-gwzjr\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.769349 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.769256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d2316de-313e-4aab-9b70-131a315cfb3c-tls-certs\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.782084 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.782012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzjr\" (UniqueName: \"kubernetes.io/projected/7d2316de-313e-4aab-9b70-131a315cfb3c-kube-api-access-gwzjr\") pod \"model-serving-api-6577596cd5-4vpfr\" (UID: \"7d2316de-313e-4aab-9b70-131a315cfb3c\") " pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:05.857559 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:05.857470 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:06.043706 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:06.042632 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4vpfr"] Jun 02 18:46:06.047775 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:06.047721 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2316de_313e_4aab_9b70_131a315cfb3c.slice/crio-fc8c327ef51cb4496224390491cbc51e6c0d44b5222270b7402016fdf622b4b6 WatchSource:0}: Error finding container fc8c327ef51cb4496224390491cbc51e6c0d44b5222270b7402016fdf622b4b6: Status 404 returned error can't find the container with id fc8c327ef51cb4496224390491cbc51e6c0d44b5222270b7402016fdf622b4b6 Jun 02 18:46:06.273013 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:06.272923 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" event={"ID":"7d2316de-313e-4aab-9b70-131a315cfb3c","Type":"ContainerStarted","Data":"fc8c327ef51cb4496224390491cbc51e6c0d44b5222270b7402016fdf622b4b6"} Jun 02 18:46:10.289425 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.289382 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-x87qh" event={"ID":"60d29a75-dc25-4d10-a335-30f383a7303e","Type":"ContainerStarted","Data":"5a90e1b3508553d8824db9b8b9e39bc538203c4572f8c387997d9bcc05d2767e"} Jun 02 18:46:10.289978 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.289510 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:10.291020 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.290985 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" event={"ID":"e13af72a-3842-48d3-88ae-58142362ec2f","Type":"ContainerStarted","Data":"59def54beea23a266a9297e414eb9cb450eed2e5717516ea208a947e0b5ad61e"} Jun 02 18:46:10.292384 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.292360 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" event={"ID":"7d2316de-313e-4aab-9b70-131a315cfb3c","Type":"ContainerStarted","Data":"de7dc6f73edfe34822e6ba413c3e22b619c4afb68a7091bfd8367aa7f8ac24da"} Jun 02 18:46:10.292515 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.292482 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:10.308205 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.308156 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-x87qh" podStartSLOduration=1.6066161700000001 podStartE2EDuration="6.308141689s" podCreationTimestamp="2026-06-02 18:46:04 +0000 UTC" firstStartedPulling="2026-06-02 18:46:05.142711194 +0000 UTC m=+376.678539981" lastFinishedPulling="2026-06-02 18:46:09.84423671 +0000 UTC m=+381.380065500" observedRunningTime="2026-06-02 18:46:10.30709393 +0000 UTC m=+381.842922742" watchObservedRunningTime="2026-06-02 18:46:10.308141689 +0000 UTC m=+381.843970499" Jun 02 18:46:10.323467 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.323416 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-grv6j" podStartSLOduration=1.5638874280000001 podStartE2EDuration="6.32340278s" podCreationTimestamp="2026-06-02 18:46:04 +0000 UTC" firstStartedPulling="2026-06-02 18:46:05.097055205 +0000 UTC m=+376.632883993" lastFinishedPulling="2026-06-02 18:46:09.856570542 +0000 UTC m=+381.392399345" observedRunningTime="2026-06-02 18:46:10.322110534 +0000 UTC m=+381.857939348" watchObservedRunningTime="2026-06-02 18:46:10.32340278 +0000 UTC m=+381.859231608" Jun 02 18:46:10.343418 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:10.343370 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" podStartSLOduration=1.5377893139999999 podStartE2EDuration="5.343353433s" podCreationTimestamp="2026-06-02 18:46:05 +0000 UTC" firstStartedPulling="2026-06-02 18:46:06.051007414 +0000 UTC m=+377.586836214" lastFinishedPulling="2026-06-02 18:46:09.856571542 +0000 UTC m=+381.392400333" observedRunningTime="2026-06-02 18:46:10.341998543 +0000 UTC m=+381.877827355" watchObservedRunningTime="2026-06-02 18:46:10.343353433 +0000 UTC m=+381.879182243" Jun 02 18:46:15.087824 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.087793 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5"] Jun 02 18:46:15.091241 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.091222 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.094603 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.094581 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 18:46:15.094723 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.094586 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2rkgp\"" Jun 02 18:46:15.099699 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.099675 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz"] Jun 02 18:46:15.102879 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.102858 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.103372 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.103352 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5"] Jun 02 18:46:15.105919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.105896 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 18:46:15.106094 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.106079 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zfc2p\"" Jun 02 18:46:15.111301 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.111281 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz"] Jun 02 18:46:15.249453 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.249412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tglbc\" (UniqueName: \"kubernetes.io/projected/18c64980-0d64-4342-bc4d-1788834c9bd8-kube-api-access-tglbc\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.249669 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.249486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s97nr\" (UniqueName: \"kubernetes.io/projected/05f7772e-7970-4b2d-8832-57a588c6cc4d-kube-api-access-s97nr\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.249669 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.249517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c64980-0d64-4342-bc4d-1788834c9bd8-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.249669 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.249619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05f7772e-7970-4b2d-8832-57a588c6cc4d-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.350162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.350063 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tglbc\" (UniqueName: \"kubernetes.io/projected/18c64980-0d64-4342-bc4d-1788834c9bd8-kube-api-access-tglbc\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.350162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.350122 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s97nr\" (UniqueName: \"kubernetes.io/projected/05f7772e-7970-4b2d-8832-57a588c6cc4d-kube-api-access-s97nr\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.350162 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.350144 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c64980-0d64-4342-bc4d-1788834c9bd8-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.350401 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.350202 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05f7772e-7970-4b2d-8832-57a588c6cc4d-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.352855 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.352820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c64980-0d64-4342-bc4d-1788834c9bd8-cert\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.352855 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.352820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05f7772e-7970-4b2d-8832-57a588c6cc4d-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.366133 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.366105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tglbc\" (UniqueName: \"kubernetes.io/projected/18c64980-0d64-4342-bc4d-1788834c9bd8-kube-api-access-tglbc\") pod \"llmisvc-controller-manager-c6b9847d7-mtnwz\" (UID: \"18c64980-0d64-4342-bc4d-1788834c9bd8\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.366277 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.366176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s97nr\" (UniqueName: \"kubernetes.io/projected/05f7772e-7970-4b2d-8832-57a588c6cc4d-kube-api-access-s97nr\") pod \"kserve-controller-manager-7c99ffcdcd-gccm5\" (UID: \"05f7772e-7970-4b2d-8832-57a588c6cc4d\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.401943 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.401902 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:15.413711 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.413679 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:15.552590 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.552559 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5"] Jun 02 18:46:15.554389 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:15.554354 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f7772e_7970_4b2d_8832_57a588c6cc4d.slice/crio-e1ef8e45758f04c8755020aa74ce64750a6c2464d9f7247fdf3c17b43aa8aeef WatchSource:0}: Error finding container e1ef8e45758f04c8755020aa74ce64750a6c2464d9f7247fdf3c17b43aa8aeef: Status 404 returned error can't find the container with id e1ef8e45758f04c8755020aa74ce64750a6c2464d9f7247fdf3c17b43aa8aeef Jun 02 18:46:15.571047 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:15.571017 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz"] Jun 02 18:46:15.573754 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:15.573712 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18c64980_0d64_4342_bc4d_1788834c9bd8.slice/crio-9000229a7230010bb2055604f23b73ac061021921600983e00ce74d70ef0d5f1 WatchSource:0}: Error finding container 9000229a7230010bb2055604f23b73ac061021921600983e00ce74d70ef0d5f1: Status 404 returned error can't find the container with id 9000229a7230010bb2055604f23b73ac061021921600983e00ce74d70ef0d5f1 Jun 02 18:46:16.312607 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:16.312567 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" event={"ID":"18c64980-0d64-4342-bc4d-1788834c9bd8","Type":"ContainerStarted","Data":"9000229a7230010bb2055604f23b73ac061021921600983e00ce74d70ef0d5f1"} Jun 02 18:46:16.313631 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:16.313605 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" event={"ID":"05f7772e-7970-4b2d-8832-57a588c6cc4d","Type":"ContainerStarted","Data":"e1ef8e45758f04c8755020aa74ce64750a6c2464d9f7247fdf3c17b43aa8aeef"} Jun 02 18:46:18.322506 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:18.322466 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" event={"ID":"05f7772e-7970-4b2d-8832-57a588c6cc4d","Type":"ContainerStarted","Data":"9870503ea5ff58a17a01d0a5da703f979e1a2f1b1f709314fc53052bc751a50b"} Jun 02 18:46:18.322938 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:18.322595 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:18.361696 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:18.361643 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" podStartSLOduration=0.781845868 podStartE2EDuration="3.361626817s" podCreationTimestamp="2026-06-02 18:46:15 +0000 UTC" firstStartedPulling="2026-06-02 18:46:15.555673797 +0000 UTC m=+387.091502584" lastFinishedPulling="2026-06-02 18:46:18.135454746 +0000 UTC m=+389.671283533" observedRunningTime="2026-06-02 18:46:18.359438427 +0000 UTC m=+389.895267238" watchObservedRunningTime="2026-06-02 18:46:18.361626817 +0000 UTC m=+389.897455642" Jun 02 18:46:19.329070 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:19.329035 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" event={"ID":"18c64980-0d64-4342-bc4d-1788834c9bd8","Type":"ContainerStarted","Data":"1d05d37c9ea48c771869c0889bdf8cf1b694691d94f3db5b45e39791031fcb19"} Jun 02 18:46:19.346757 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:19.346679 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" podStartSLOduration=0.987544256 podStartE2EDuration="4.346663837s" podCreationTimestamp="2026-06-02 18:46:15 +0000 UTC" firstStartedPulling="2026-06-02 18:46:15.575190733 +0000 UTC m=+387.111019521" lastFinishedPulling="2026-06-02 18:46:18.934310312 +0000 UTC m=+390.470139102" observedRunningTime="2026-06-02 18:46:19.345340556 +0000 UTC m=+390.881169366" watchObservedRunningTime="2026-06-02 18:46:19.346663837 +0000 UTC m=+390.882492647" Jun 02 18:46:20.332154 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:20.332120 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:46:21.299070 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:21.299038 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-x87qh" Jun 02 18:46:21.301028 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:21.301007 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-4vpfr" Jun 02 18:46:23.235888 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.235855 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx"] Jun 02 18:46:23.245986 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.245938 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.249160 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.249135 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 18:46:23.249586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.249552 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 18:46:23.249693 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.249666 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-btjcx\"" Jun 02 18:46:23.255539 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.255516 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx"] Jun 02 18:46:23.320890 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.320846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qjq\" (UniqueName: \"kubernetes.io/projected/21301ff0-a415-47dc-a68e-a7c1aee8b3df-kube-api-access-x8qjq\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.321095 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.320934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/21301ff0-a415-47dc-a68e-a7c1aee8b3df-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.422040 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.421995 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/21301ff0-a415-47dc-a68e-a7c1aee8b3df-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.422233 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.422130 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qjq\" (UniqueName: \"kubernetes.io/projected/21301ff0-a415-47dc-a68e-a7c1aee8b3df-kube-api-access-x8qjq\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.424668 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.424645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/21301ff0-a415-47dc-a68e-a7c1aee8b3df-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.432148 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.432116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qjq\" (UniqueName: \"kubernetes.io/projected/21301ff0-a415-47dc-a68e-a7c1aee8b3df-kube-api-access-x8qjq\") pod \"servicemesh-operator3-55f49c5f94-jnhsx\" (UID: \"21301ff0-a415-47dc-a68e-a7c1aee8b3df\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.556191 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.556155 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:23.696897 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:23.696864 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx"] Jun 02 18:46:23.699281 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:23.699250 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21301ff0_a415_47dc_a68e_a7c1aee8b3df.slice/crio-1574a83d04e142ab786d4034b218cc41e2bb1b233da5eeb33d64c0f4251ddc16 WatchSource:0}: Error finding container 1574a83d04e142ab786d4034b218cc41e2bb1b233da5eeb33d64c0f4251ddc16: Status 404 returned error can't find the container with id 1574a83d04e142ab786d4034b218cc41e2bb1b233da5eeb33d64c0f4251ddc16 Jun 02 18:46:24.346189 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:24.346160 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" event={"ID":"21301ff0-a415-47dc-a68e-a7c1aee8b3df","Type":"ContainerStarted","Data":"1574a83d04e142ab786d4034b218cc41e2bb1b233da5eeb33d64c0f4251ddc16"} Jun 02 18:46:27.357100 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:27.357060 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" event={"ID":"21301ff0-a415-47dc-a68e-a7c1aee8b3df","Type":"ContainerStarted","Data":"57952db3cec3aec0507b2c3a0745dd7c6d98f1201d22cdb82394f878e5dc7472"} Jun 02 18:46:27.357579 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:27.357235 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:27.379254 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:27.379195 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" podStartSLOduration=1.571379851 podStartE2EDuration="4.379175842s" podCreationTimestamp="2026-06-02 18:46:23 +0000 UTC" firstStartedPulling="2026-06-02 18:46:23.70181318 +0000 UTC m=+395.237641969" lastFinishedPulling="2026-06-02 18:46:26.509609157 +0000 UTC m=+398.045437960" observedRunningTime="2026-06-02 18:46:27.377045933 +0000 UTC m=+398.912874768" watchObservedRunningTime="2026-06-02 18:46:27.379175842 +0000 UTC m=+398.915004654" Jun 02 18:46:31.843645 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.843608 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h"] Jun 02 18:46:31.846997 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.846977 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.849905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.849883 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 18:46:31.850056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.850024 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 18:46:31.850183 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.850104 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 18:46:31.850183 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.850172 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 18:46:31.850327 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.850308 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fgt29\"" Jun 02 18:46:31.858845 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.858821 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h"] Jun 02 18:46:31.887613 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-token\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.887613 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.887861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbe9906-2cb0-411b-a557-14ebd510cbea-local-certs\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.887861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.887861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.887861 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q9v9\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-kube-api-access-2q9v9\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.888010 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.887862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-cacerts\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989005 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.988964 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989005 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989010 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989266 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989141 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q9v9\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-kube-api-access-2q9v9\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989266 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989196 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-cacerts\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989266 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989254 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-token\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989430 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989272 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989430 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989303 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbe9906-2cb0-411b-a557-14ebd510cbea-local-certs\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.989653 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.989617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.991643 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.991612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.991771 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.991683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbe9906-2cb0-411b-a557-14ebd510cbea-local-certs\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.991771 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.991718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-cacerts\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.991771 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.991728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.997836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.997797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-istio-token\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:31.998792 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:31.998770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q9v9\" (UniqueName: \"kubernetes.io/projected/dbbe9906-2cb0-411b-a557-14ebd510cbea-kube-api-access-2q9v9\") pod \"istiod-openshift-gateway-798958bb55-8pr2h\" (UID: \"dbbe9906-2cb0-411b-a557-14ebd510cbea\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:32.156208 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:32.156117 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:32.317147 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:32.317120 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h"] Jun 02 18:46:32.320055 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:32.320016 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbe9906_2cb0_411b_a557_14ebd510cbea.slice/crio-ecf6a81d48d1fc162b4427b57a57c957e442e912c1f0b5f1c9b06af4eb4532f8 WatchSource:0}: Error finding container ecf6a81d48d1fc162b4427b57a57c957e442e912c1f0b5f1c9b06af4eb4532f8: Status 404 returned error can't find the container with id ecf6a81d48d1fc162b4427b57a57c957e442e912c1f0b5f1c9b06af4eb4532f8 Jun 02 18:46:32.373501 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:32.373454 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" event={"ID":"dbbe9906-2cb0-411b-a557-14ebd510cbea","Type":"ContainerStarted","Data":"ecf6a81d48d1fc162b4427b57a57c957e442e912c1f0b5f1c9b06af4eb4532f8"} Jun 02 18:46:34.977421 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:34.977384 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:46:34.977696 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:34.977453 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:46:35.387410 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:35.387289 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" event={"ID":"dbbe9906-2cb0-411b-a557-14ebd510cbea","Type":"ContainerStarted","Data":"120c5ea97e3f4c55245386e40a9cc89b0d30224c1ee081ceaf3a23aab31bd4fa"} Jun 02 18:46:35.388187 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:35.388152 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:35.418696 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:35.418630 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" podStartSLOduration=1.7676624859999999 podStartE2EDuration="4.418598679s" podCreationTimestamp="2026-06-02 18:46:31 +0000 UTC" firstStartedPulling="2026-06-02 18:46:32.326213542 +0000 UTC m=+403.862042344" lastFinishedPulling="2026-06-02 18:46:34.977149747 +0000 UTC m=+406.512978537" observedRunningTime="2026-06-02 18:46:35.41545427 +0000 UTC m=+406.951283081" watchObservedRunningTime="2026-06-02 18:46:35.418598679 +0000 UTC m=+406.954427490" Jun 02 18:46:36.392294 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:36.392260 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-8pr2h" Jun 02 18:46:38.363123 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:38.363088 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jnhsx" Jun 02 18:46:39.895297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:39.895266 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-kbrb5"] Jun 02 18:46:39.960386 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:39.960345 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-kbrb5"] Jun 02 18:46:39.960577 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:39.960467 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:39.964315 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:39.964286 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vt8v5\"" Jun 02 18:46:39.964451 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:39.964432 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 18:46:40.065548 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.065505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxs9\" (UniqueName: \"kubernetes.io/projected/f458590e-98d8-41f2-b196-922b0e773a61-kube-api-access-2qxs9\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.065714 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.065644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f458590e-98d8-41f2-b196-922b0e773a61-redirect-config\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.167091 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.167001 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxs9\" (UniqueName: \"kubernetes.io/projected/f458590e-98d8-41f2-b196-922b0e773a61-kube-api-access-2qxs9\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.167227 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.167096 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f458590e-98d8-41f2-b196-922b0e773a61-redirect-config\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.167814 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.167795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f458590e-98d8-41f2-b196-922b0e773a61-redirect-config\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.179050 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.179026 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxs9\" (UniqueName: \"kubernetes.io/projected/f458590e-98d8-41f2-b196-922b0e773a61-kube-api-access-2qxs9\") pod \"dashboard-redirect-8d496bf45-kbrb5\" (UID: \"f458590e-98d8-41f2-b196-922b0e773a61\") " pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.271626 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.271594 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" Jun 02 18:46:40.406632 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:40.406615 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-kbrb5"] Jun 02 18:46:40.409303 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:46:40.409276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf458590e_98d8_41f2_b196_922b0e773a61.slice/crio-8591d6eabc7959e5e0ead744a747fc084efd16a01647fbfe6c0b2f1f89ace850 WatchSource:0}: Error finding container 8591d6eabc7959e5e0ead744a747fc084efd16a01647fbfe6c0b2f1f89ace850: Status 404 returned error can't find the container with id 8591d6eabc7959e5e0ead744a747fc084efd16a01647fbfe6c0b2f1f89ace850 Jun 02 18:46:41.407558 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:41.407523 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" event={"ID":"f458590e-98d8-41f2-b196-922b0e773a61","Type":"ContainerStarted","Data":"8591d6eabc7959e5e0ead744a747fc084efd16a01647fbfe6c0b2f1f89ace850"} Jun 02 18:46:43.421331 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:43.421289 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" event={"ID":"f458590e-98d8-41f2-b196-922b0e773a61","Type":"ContainerStarted","Data":"54317c5db53056d4ffb83fd99bb5931ec3611941605f81349a65d47f631f56b3"} Jun 02 18:46:43.439273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:43.439222 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8d496bf45-kbrb5" podStartSLOduration=1.894952409 podStartE2EDuration="4.4392075s" podCreationTimestamp="2026-06-02 18:46:39 +0000 UTC" firstStartedPulling="2026-06-02 18:46:40.410506937 +0000 UTC m=+411.946335725" lastFinishedPulling="2026-06-02 18:46:42.954762011 +0000 UTC m=+414.490590816" observedRunningTime="2026-06-02 18:46:43.43736739 +0000 UTC m=+414.973196200" watchObservedRunningTime="2026-06-02 18:46:43.4392075 +0000 UTC m=+414.975036371" Jun 02 18:46:49.334521 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:49.334485 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gccm5" Jun 02 18:46:51.338238 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:46:51.338206 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-mtnwz" Jun 02 18:47:40.596670 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.596619 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc"] Jun 02 18:47:40.599994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.599972 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:40.602939 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.602919 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 18:47:40.604142 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.604116 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 18:47:40.604274 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.604144 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 18:47:40.604274 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.604144 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-b5n6s\"" Jun 02 18:47:40.617760 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.615527 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc"] Jun 02 18:47:40.676010 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.675973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glxf\" (UniqueName: \"kubernetes.io/projected/701691ce-795e-4317-88dd-e56a647ffe71-kube-api-access-5glxf\") pod \"dns-operator-controller-manager-648d5c98bc-5zpvc\" (UID: \"701691ce-795e-4317-88dd-e56a647ffe71\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:40.777257 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.777218 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5glxf\" (UniqueName: \"kubernetes.io/projected/701691ce-795e-4317-88dd-e56a647ffe71-kube-api-access-5glxf\") pod \"dns-operator-controller-manager-648d5c98bc-5zpvc\" (UID: \"701691ce-795e-4317-88dd-e56a647ffe71\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:40.791504 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.791463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glxf\" (UniqueName: \"kubernetes.io/projected/701691ce-795e-4317-88dd-e56a647ffe71-kube-api-access-5glxf\") pod \"dns-operator-controller-manager-648d5c98bc-5zpvc\" (UID: \"701691ce-795e-4317-88dd-e56a647ffe71\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:40.919713 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:40.919615 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:41.053665 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:41.053638 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc"] Jun 02 18:47:41.056350 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:47:41.056312 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701691ce_795e_4317_88dd_e56a647ffe71.slice/crio-91fa8c947131add12426f4cb1741089c28b0d7cda7d7d96ea36280ce3b836af9 WatchSource:0}: Error finding container 91fa8c947131add12426f4cb1741089c28b0d7cda7d7d96ea36280ce3b836af9: Status 404 returned error can't find the container with id 91fa8c947131add12426f4cb1741089c28b0d7cda7d7d96ea36280ce3b836af9 Jun 02 18:47:41.624556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:41.624523 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" event={"ID":"701691ce-795e-4317-88dd-e56a647ffe71","Type":"ContainerStarted","Data":"91fa8c947131add12426f4cb1741089c28b0d7cda7d7d96ea36280ce3b836af9"} Jun 02 18:47:43.633044 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:43.633004 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" event={"ID":"701691ce-795e-4317-88dd-e56a647ffe71","Type":"ContainerStarted","Data":"c8c52074af7485de06fcecb1cbd633e4a992f6743a234d476e959d7bb2d1c989"} Jun 02 18:47:43.633516 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:43.633158 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:47:43.651149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:43.651103 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" podStartSLOduration=1.754195689 podStartE2EDuration="3.651088653s" podCreationTimestamp="2026-06-02 18:47:40 +0000 UTC" firstStartedPulling="2026-06-02 18:47:41.058795648 +0000 UTC m=+472.594624436" lastFinishedPulling="2026-06-02 18:47:42.955688611 +0000 UTC m=+474.491517400" observedRunningTime="2026-06-02 18:47:43.649365087 +0000 UTC m=+475.185193898" watchObservedRunningTime="2026-06-02 18:47:43.651088653 +0000 UTC m=+475.186917463" Jun 02 18:47:47.787974 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.787931 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf"] Jun 02 18:47:47.792604 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.792569 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:47.796204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.796185 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xsfc7\"" Jun 02 18:47:47.806171 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.806147 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf"] Jun 02 18:47:47.939583 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.939541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh57h\" (UniqueName: \"kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:47.939583 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:47.939588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.040445 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.040350 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.040445 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.040439 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh57h\" (UniqueName: \"kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.040829 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.040810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.050568 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.050543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh57h\" (UniqueName: \"kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.102933 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.102894 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:48.237442 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.237417 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf"] Jun 02 18:47:48.239498 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:47:48.239472 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16384f6e_55fa_47eb_a41e_66978dc6571c.slice/crio-192a61e68ce33b9be52af95dbd03af3e16841d9e475e0bf2966af66a88719c20 WatchSource:0}: Error finding container 192a61e68ce33b9be52af95dbd03af3e16841d9e475e0bf2966af66a88719c20: Status 404 returned error can't find the container with id 192a61e68ce33b9be52af95dbd03af3e16841d9e475e0bf2966af66a88719c20 Jun 02 18:47:48.651159 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:48.651119 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" event={"ID":"16384f6e-55fa-47eb-a41e-66978dc6571c","Type":"ContainerStarted","Data":"192a61e68ce33b9be52af95dbd03af3e16841d9e475e0bf2966af66a88719c20"} Jun 02 18:47:53.675028 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:53.674926 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" event={"ID":"16384f6e-55fa-47eb-a41e-66978dc6571c","Type":"ContainerStarted","Data":"053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a"} Jun 02 18:47:53.675479 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:53.675082 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:47:53.696932 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:53.696870 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" podStartSLOduration=1.657473521 podStartE2EDuration="6.696851095s" podCreationTimestamp="2026-06-02 18:47:47 +0000 UTC" firstStartedPulling="2026-06-02 18:47:48.242305969 +0000 UTC m=+479.778134756" lastFinishedPulling="2026-06-02 18:47:53.281683541 +0000 UTC m=+484.817512330" observedRunningTime="2026-06-02 18:47:53.694204929 +0000 UTC m=+485.230033752" watchObservedRunningTime="2026-06-02 18:47:53.696851095 +0000 UTC m=+485.232680100" Jun 02 18:47:54.638305 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:47:54.638266 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5zpvc" Jun 02 18:48:04.681668 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:04.681635 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:48:05.709067 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.709027 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5"] Jun 02 18:48:05.712480 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.712452 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:05.731370 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.731339 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5"] Jun 02 18:48:05.891026 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.890996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:05.891194 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.891034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89lkk\" (UniqueName: \"kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:05.992206 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.992109 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:05.992206 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.992154 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89lkk\" (UniqueName: \"kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:05.992483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:05.992463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:06.000246 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.000219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89lkk\" (UniqueName: \"kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:06.023189 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.023158 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:06.161536 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.161504 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5"] Jun 02 18:48:06.166147 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:48:06.166106 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47c64f6_4091_491e_8cf8_a400fdaf7ce0.slice/crio-ed46f227b203a78b345c79f90898fc7a530c033895934b4bc6c0531d9462ac02 WatchSource:0}: Error finding container ed46f227b203a78b345c79f90898fc7a530c033895934b4bc6c0531d9462ac02: Status 404 returned error can't find the container with id ed46f227b203a78b345c79f90898fc7a530c033895934b4bc6c0531d9462ac02 Jun 02 18:48:06.323178 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.323141 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf"] Jun 02 18:48:06.323392 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.323347 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" containerName="manager" containerID="cri-o://053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a" gracePeriod=2 Jun 02 18:48:06.330666 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.330633 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf"] Jun 02 18:48:06.342057 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.342029 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5"] Jun 02 18:48:06.350803 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.350777 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5"] Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.370376 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.370881 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" containerName="manager" Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.370899 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" containerName="manager" Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.370931 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" containerName="manager" Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.370939 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" containerName="manager" Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.371008 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" containerName="manager" Jun 02 18:48:06.374172 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.371023 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" containerName="manager" Jun 02 18:48:06.376130 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.375260 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.390331 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.390299 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:06.408238 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.408195 2564 status_manager.go:895] "Failed to get status for pod" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.496352 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.496323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.496506 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.496374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4x9\" (UniqueName: \"kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.564976 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.564951 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:48:06.567568 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.567543 2564 status_manager.go:895] "Failed to get status for pod" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.597883 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.597790 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.597883 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.597877 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4x9\" (UniqueName: \"kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.598179 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.598158 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.611374 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.611349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4x9\" (UniqueName: \"kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.698551 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.698511 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh57h\" (UniqueName: \"kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h\") pod \"16384f6e-55fa-47eb-a41e-66978dc6571c\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " Jun 02 18:48:06.698716 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.698581 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume\") pod \"16384f6e-55fa-47eb-a41e-66978dc6571c\" (UID: \"16384f6e-55fa-47eb-a41e-66978dc6571c\") " Jun 02 18:48:06.699090 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.699067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16384f6e-55fa-47eb-a41e-66978dc6571c" (UID: "16384f6e-55fa-47eb-a41e-66978dc6571c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:48:06.700803 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.700781 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h" (OuterVolumeSpecName: "kube-api-access-gh57h") pod "16384f6e-55fa-47eb-a41e-66978dc6571c" (UID: "16384f6e-55fa-47eb-a41e-66978dc6571c"). InnerVolumeSpecName "kube-api-access-gh57h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:06.702934 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.702916 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:06.723709 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.723669 2564 generic.go:358] "Generic (PLEG): container finished" podID="16384f6e-55fa-47eb-a41e-66978dc6571c" containerID="053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a" exitCode=0 Jun 02 18:48:06.724147 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.723722 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" Jun 02 18:48:06.724147 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.723779 2564 scope.go:117] "RemoveContainer" containerID="053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a" Jun 02 18:48:06.725989 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:48:06.725963 2564 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" container="manager" Jun 02 18:48:06.726520 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.726492 2564 status_manager.go:895] "Failed to get status for pod" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.728624 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.728591 2564 status_manager.go:895] "Failed to get status for pod" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.730920 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.730891 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.734630 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.734536 2564 scope.go:117] "RemoveContainer" containerID="053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a" Jun 02 18:48:06.735040 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:48:06.734981 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a\": container with ID starting with 053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a not found: ID does not exist" containerID="053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a" Jun 02 18:48:06.735040 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.735013 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a"} err="failed to get container status \"053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a\": rpc error: code = NotFound desc = could not find container \"053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a\": container with ID starting with 053fec3e61b2b8f1cd499851eaa70aa0ddea80e5171deef3af8ecfddb643183a not found: ID does not exist" Jun 02 18:48:06.740524 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.740496 2564 status_manager.go:895] "Failed to get status for pod" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-cdzpf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-cdzpf\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.742720 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.742690 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:06.799516 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.799474 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh57h\" (UniqueName: \"kubernetes.io/projected/16384f6e-55fa-47eb-a41e-66978dc6571c-kube-api-access-gh57h\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:06.799516 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.799514 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16384f6e-55fa-47eb-a41e-66978dc6571c-extensions-socket-volume\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:06.854116 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:06.853752 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:06.856513 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:48:06.856480 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad8bce2_92d5_4cbb_8fc7_2acafa3f3d3f.slice/crio-8e191460052370bece0fa69846f85124e1032b7ff236ee4366529691e02f48a5 WatchSource:0}: Error finding container 8e191460052370bece0fa69846f85124e1032b7ff236ee4366529691e02f48a5: Status 404 returned error can't find the container with id 8e191460052370bece0fa69846f85124e1032b7ff236ee4366529691e02f48a5 Jun 02 18:48:07.085626 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.085590 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16384f6e-55fa-47eb-a41e-66978dc6571c" path="/var/lib/kubelet/pods/16384f6e-55fa-47eb-a41e-66978dc6571c/volumes" Jun 02 18:48:07.731577 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.731516 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" containerName="manager" containerID="cri-o://e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5" gracePeriod=2 Jun 02 18:48:07.732994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.732957 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" event={"ID":"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f","Type":"ContainerStarted","Data":"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c"} Jun 02 18:48:07.732994 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.732990 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" event={"ID":"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f","Type":"ContainerStarted","Data":"8e191460052370bece0fa69846f85124e1032b7ff236ee4366529691e02f48a5"} Jun 02 18:48:07.733118 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.733093 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:07.754963 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.754911 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" podStartSLOduration=1.754896027 podStartE2EDuration="1.754896027s" podCreationTimestamp="2026-06-02 18:48:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:48:07.753715367 +0000 UTC m=+499.289544189" watchObservedRunningTime="2026-06-02 18:48:07.754896027 +0000 UTC m=+499.290724836" Jun 02 18:48:07.971816 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.971790 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:07.974452 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:07.974422 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:08.110532 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.110488 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89lkk\" (UniqueName: \"kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk\") pod \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " Jun 02 18:48:08.110708 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.110578 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume\") pod \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\" (UID: \"c47c64f6-4091-491e-8cf8-a400fdaf7ce0\") " Jun 02 18:48:08.110907 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.110874 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c47c64f6-4091-491e-8cf8-a400fdaf7ce0" (UID: "c47c64f6-4091-491e-8cf8-a400fdaf7ce0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:48:08.112835 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.112816 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk" (OuterVolumeSpecName: "kube-api-access-89lkk") pod "c47c64f6-4091-491e-8cf8-a400fdaf7ce0" (UID: "c47c64f6-4091-491e-8cf8-a400fdaf7ce0"). InnerVolumeSpecName "kube-api-access-89lkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:08.211447 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.211401 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89lkk\" (UniqueName: \"kubernetes.io/projected/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-kube-api-access-89lkk\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:08.211447 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.211441 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47c64f6-4091-491e-8cf8-a400fdaf7ce0-extensions-socket-volume\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:08.738048 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.738013 2564 generic.go:358] "Generic (PLEG): container finished" podID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" containerID="e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5" exitCode=2 Jun 02 18:48:08.738465 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.738059 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" Jun 02 18:48:08.738465 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.738113 2564 scope.go:117] "RemoveContainer" containerID="e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5" Jun 02 18:48:08.741024 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.740990 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:08.747467 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.747443 2564 scope.go:117] "RemoveContainer" containerID="e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5" Jun 02 18:48:08.747780 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:48:08.747726 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5\": container with ID starting with e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5 not found: ID does not exist" containerID="e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5" Jun 02 18:48:08.747854 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.747785 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5"} err="failed to get container status \"e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5\": rpc error: code = NotFound desc = could not find container \"e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5\": container with ID starting with e2fc03b2230bb63b75905cc43cc8ff30a6d60f16c1c88d7e8602935403ce58c5 not found: ID does not exist" Jun 02 18:48:08.750259 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:08.750235 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:09.084153 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:09.084115 2564 status_manager.go:895] "Failed to get status for pod" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-5szw5" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-5szw5\" is forbidden: User \"system:node:ip-10-0-128-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-123.ec2.internal' and this object" Jun 02 18:48:09.084776 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:09.084729 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c47c64f6-4091-491e-8cf8-a400fdaf7ce0" path="/var/lib/kubelet/pods/c47c64f6-4091-491e-8cf8-a400fdaf7ce0/volumes" Jun 02 18:48:18.740990 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:18.740954 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:31.474857 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.474813 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:31.475398 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.475136 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" podUID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" containerName="manager" containerID="cri-o://91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c" gracePeriod=10 Jun 02 18:48:31.721752 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.721712 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:31.816161 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.816119 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume\") pod \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " Jun 02 18:48:31.816335 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.816182 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx4x9\" (UniqueName: \"kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9\") pod \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\" (UID: \"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f\") " Jun 02 18:48:31.816556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.816534 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" (UID: "0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:48:31.818375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.818352 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9" (OuterVolumeSpecName: "kube-api-access-gx4x9") pod "0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" (UID: "0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f"). InnerVolumeSpecName "kube-api-access-gx4x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:31.823428 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.823400 2564 generic.go:358] "Generic (PLEG): container finished" podID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" containerID="91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c" exitCode=0 Jun 02 18:48:31.823556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.823459 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" Jun 02 18:48:31.823556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.823480 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" event={"ID":"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f","Type":"ContainerDied","Data":"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c"} Jun 02 18:48:31.823556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.823517 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg" event={"ID":"0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f","Type":"ContainerDied","Data":"8e191460052370bece0fa69846f85124e1032b7ff236ee4366529691e02f48a5"} Jun 02 18:48:31.823556 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.823532 2564 scope.go:117] "RemoveContainer" containerID="91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c" Jun 02 18:48:31.832289 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.832271 2564 scope.go:117] "RemoveContainer" containerID="91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c" Jun 02 18:48:31.832544 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:48:31.832527 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c\": container with ID starting with 91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c not found: ID does not exist" containerID="91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c" Jun 02 18:48:31.832583 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.832555 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c"} err="failed to get container status \"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c\": rpc error: code = NotFound desc = could not find container \"91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c\": container with ID starting with 91c77b719fff1cdb86fac003dc305853590218b9213f9a7064b0266cb19f537c not found: ID does not exist" Jun 02 18:48:31.845248 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.845218 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:31.851524 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.851499 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7rqkg"] Jun 02 18:48:31.917017 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.916982 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx4x9\" (UniqueName: \"kubernetes.io/projected/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-kube-api-access-gx4x9\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:31.917017 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:31.917012 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f-extensions-socket-volume\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:48:33.084209 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:33.084176 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" path="/var/lib/kubelet/pods/0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f/volumes" Jun 02 18:48:35.088042 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.088010 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc"] Jun 02 18:48:35.089149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.089115 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" containerName="manager" Jun 02 18:48:35.089149 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.089150 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" containerName="manager" Jun 02 18:48:35.089326 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.089317 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ad8bce2-92d5-4cbb-8fc7-2acafa3f3d3f" containerName="manager" Jun 02 18:48:35.094919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.094888 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.098996 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.098974 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xbnbl\"" Jun 02 18:48:35.120089 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.120053 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc"] Jun 02 18:48:35.140483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140483 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140689 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.140836 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.140820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qkn\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-kube-api-access-99qkn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.241976 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.241941 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.241976 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.241978 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242239 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242123 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242239 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242167 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242239 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242213 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99qkn\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-kube-api-access-99qkn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242394 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242306 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242394 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242335 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242394 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242375 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242429 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242534 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242453 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242780 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.242858 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.242840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.243132 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.243102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.244705 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.244685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.244852 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.244828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.252517 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.252492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.252649 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.252628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qkn\" (UniqueName: \"kubernetes.io/projected/e2c3d8de-f33a-45b8-8a21-df35a1ad00d6-kube-api-access-99qkn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-4r9jc\" (UID: \"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.406125 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.406039 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:35.564076 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.563965 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc"] Jun 02 18:48:35.566839 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:48:35.566804 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c3d8de_f33a_45b8_8a21_df35a1ad00d6.slice/crio-307e4c679e0427817c81d8d9f0485427a9b719731a130fb1b2d4de8713da2d8e WatchSource:0}: Error finding container 307e4c679e0427817c81d8d9f0485427a9b719731a130fb1b2d4de8713da2d8e: Status 404 returned error can't find the container with id 307e4c679e0427817c81d8d9f0485427a9b719731a130fb1b2d4de8713da2d8e Jun 02 18:48:35.839144 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:35.839101 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" event={"ID":"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6","Type":"ContainerStarted","Data":"307e4c679e0427817c81d8d9f0485427a9b719731a130fb1b2d4de8713da2d8e"} Jun 02 18:48:38.422346 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:38.422311 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:48:38.422713 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:38.422405 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:48:38.422713 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:38.422453 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:48:38.851952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:38.851905 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" event={"ID":"e2c3d8de-f33a-45b8-8a21-df35a1ad00d6","Type":"ContainerStarted","Data":"a06d3ce1c1be547b3ec0c609170b8260ee9131609df492207f61115d12d1b609"} Jun 02 18:48:38.874049 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:38.873997 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" podStartSLOduration=1.020932555 podStartE2EDuration="3.87398382s" podCreationTimestamp="2026-06-02 18:48:35 +0000 UTC" firstStartedPulling="2026-06-02 18:48:35.568956746 +0000 UTC m=+527.104785539" lastFinishedPulling="2026-06-02 18:48:38.422008012 +0000 UTC m=+529.957836804" observedRunningTime="2026-06-02 18:48:38.870709934 +0000 UTC m=+530.406538741" watchObservedRunningTime="2026-06-02 18:48:38.87398382 +0000 UTC m=+530.409812629" Jun 02 18:48:39.406574 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:39.406539 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:39.411228 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:39.411200 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:39.855997 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:39.855966 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:39.857154 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:39.857132 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-4r9jc" Jun 02 18:48:52.998451 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:52.998414 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:48:53.002980 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.002962 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.006152 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.006132 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 18:48:53.006261 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.006134 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cwcfj\"" Jun 02 18:48:53.018550 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.018521 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:48:53.070136 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.070108 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:48:53.105194 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.105156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j8qp\" (UniqueName: \"kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.105374 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.105265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.206598 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.206558 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j8qp\" (UniqueName: \"kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.206797 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.206641 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.207284 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.207262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.226848 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.226808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j8qp\" (UniqueName: \"kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp\") pod \"limitador-limitador-7d549b5b-7g8d5\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.314071 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.314029 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:53.468907 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.468863 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:48:53.470508 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:48:53.470482 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515940bd_342e_471e_957c_18f80fa45e96.slice/crio-9486edc596d951a8b5261bdcd17cda3e7d17948dfb8f9ba9090b528b4b0ef9ed WatchSource:0}: Error finding container 9486edc596d951a8b5261bdcd17cda3e7d17948dfb8f9ba9090b528b4b0ef9ed: Status 404 returned error can't find the container with id 9486edc596d951a8b5261bdcd17cda3e7d17948dfb8f9ba9090b528b4b0ef9ed Jun 02 18:48:53.905244 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:53.905205 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" event={"ID":"515940bd-342e-471e-957c-18f80fa45e96","Type":"ContainerStarted","Data":"9486edc596d951a8b5261bdcd17cda3e7d17948dfb8f9ba9090b528b4b0ef9ed"} Jun 02 18:48:56.919813 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:56.919772 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" event={"ID":"515940bd-342e-471e-957c-18f80fa45e96","Type":"ContainerStarted","Data":"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12"} Jun 02 18:48:56.920219 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:56.919895 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:48:56.940265 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:48:56.940216 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" podStartSLOduration=2.212608172 podStartE2EDuration="4.940200997s" podCreationTimestamp="2026-06-02 18:48:52 +0000 UTC" firstStartedPulling="2026-06-02 18:48:53.47227831 +0000 UTC m=+545.008107099" lastFinishedPulling="2026-06-02 18:48:56.199871136 +0000 UTC m=+547.735699924" observedRunningTime="2026-06-02 18:48:56.93882915 +0000 UTC m=+548.474657972" watchObservedRunningTime="2026-06-02 18:48:56.940200997 +0000 UTC m=+548.476029832" Jun 02 18:49:07.924239 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:07.924209 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:49:09.963280 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:09.963238 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:49:09.963760 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:09.963472 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" podUID="515940bd-342e-471e-957c-18f80fa45e96" containerName="limitador" containerID="cri-o://5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12" gracePeriod=30 Jun 02 18:49:10.920658 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.920634 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:49:10.949757 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.949709 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file\") pod \"515940bd-342e-471e-957c-18f80fa45e96\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " Jun 02 18:49:10.949878 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.949808 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j8qp\" (UniqueName: \"kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp\") pod \"515940bd-342e-471e-957c-18f80fa45e96\" (UID: \"515940bd-342e-471e-957c-18f80fa45e96\") " Jun 02 18:49:10.950048 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.950027 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file" (OuterVolumeSpecName: "config-file") pod "515940bd-342e-471e-957c-18f80fa45e96" (UID: "515940bd-342e-471e-957c-18f80fa45e96"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:49:10.951933 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.951912 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp" (OuterVolumeSpecName: "kube-api-access-2j8qp") pod "515940bd-342e-471e-957c-18f80fa45e96" (UID: "515940bd-342e-471e-957c-18f80fa45e96"). InnerVolumeSpecName "kube-api-access-2j8qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:49:10.971624 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.971587 2564 generic.go:358] "Generic (PLEG): container finished" podID="515940bd-342e-471e-957c-18f80fa45e96" containerID="5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12" exitCode=0 Jun 02 18:49:10.972056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.971650 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" Jun 02 18:49:10.972056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.971675 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" event={"ID":"515940bd-342e-471e-957c-18f80fa45e96","Type":"ContainerDied","Data":"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12"} Jun 02 18:49:10.972056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.971722 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7g8d5" event={"ID":"515940bd-342e-471e-957c-18f80fa45e96","Type":"ContainerDied","Data":"9486edc596d951a8b5261bdcd17cda3e7d17948dfb8f9ba9090b528b4b0ef9ed"} Jun 02 18:49:10.972056 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.971765 2564 scope.go:117] "RemoveContainer" containerID="5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12" Jun 02 18:49:10.980509 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.980489 2564 scope.go:117] "RemoveContainer" containerID="5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12" Jun 02 18:49:10.980841 ip-10-0-128-123 kubenswrapper[2564]: E0602 18:49:10.980824 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12\": container with ID starting with 5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12 not found: ID does not exist" containerID="5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12" Jun 02 18:49:10.980903 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:10.980848 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12"} err="failed to get container status \"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12\": rpc error: code = NotFound desc = could not find container \"5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12\": container with ID starting with 5cf2bd7ac258fd5707c7c38c71abc28f6c43a921fcd21923ce2c1d778fde8f12 not found: ID does not exist" Jun 02 18:49:11.009785 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:11.009673 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:49:11.014487 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:11.014458 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7g8d5"] Jun 02 18:49:11.051105 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:11.051019 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j8qp\" (UniqueName: \"kubernetes.io/projected/515940bd-342e-471e-957c-18f80fa45e96-kube-api-access-2j8qp\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:49:11.051105 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:11.051063 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/515940bd-342e-471e-957c-18f80fa45e96-config-file\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 02 18:49:11.084652 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:11.084618 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515940bd-342e-471e-957c-18f80fa45e96" path="/var/lib/kubelet/pods/515940bd-342e-471e-957c-18f80fa45e96/volumes" Jun 02 18:49:15.925769 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.925719 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tl7lh"] Jun 02 18:49:15.926140 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.926109 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515940bd-342e-471e-957c-18f80fa45e96" containerName="limitador" Jun 02 18:49:15.926140 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.926121 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="515940bd-342e-471e-957c-18f80fa45e96" containerName="limitador" Jun 02 18:49:15.926209 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.926197 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="515940bd-342e-471e-957c-18f80fa45e96" containerName="limitador" Jun 02 18:49:15.931237 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.931213 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:15.935513 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.935486 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 18:49:15.954274 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.954246 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tl7lh"] Jun 02 18:49:15.993152 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.993121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rn8\" (UniqueName: \"kubernetes.io/projected/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-kube-api-access-h2rn8\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:15.993356 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:15.993162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-data\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.094257 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.094209 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rn8\" (UniqueName: \"kubernetes.io/projected/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-kube-api-access-h2rn8\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.094257 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.094264 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-data\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.094677 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.094654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-data\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.105205 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.105180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rn8\" (UniqueName: \"kubernetes.io/projected/877b631d-47d0-4fb3-9f9c-6e5fe6d742e9-kube-api-access-h2rn8\") pod \"postgres-68c4fbbd6f-tl7lh\" (UID: \"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9\") " pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.242185 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.242091 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:16.380514 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.380429 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-tl7lh"] Jun 02 18:49:16.383423 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:49:16.383386 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877b631d_47d0_4fb3_9f9c_6e5fe6d742e9.slice/crio-9c1971a86e20c5e215ee88f3322eef81d8f74549e7f56d831b16d57f9ac1ba1b WatchSource:0}: Error finding container 9c1971a86e20c5e215ee88f3322eef81d8f74549e7f56d831b16d57f9ac1ba1b: Status 404 returned error can't find the container with id 9c1971a86e20c5e215ee88f3322eef81d8f74549e7f56d831b16d57f9ac1ba1b Jun 02 18:49:16.993600 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:16.993565 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" event={"ID":"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9","Type":"ContainerStarted","Data":"9c1971a86e20c5e215ee88f3322eef81d8f74549e7f56d831b16d57f9ac1ba1b"} Jun 02 18:49:22.010631 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:22.010596 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" event={"ID":"877b631d-47d0-4fb3-9f9c-6e5fe6d742e9","Type":"ContainerStarted","Data":"90f6dc2c14f1969eaa731af6fef60ce77952ac90ed7cb1da5f7823ecf4eab04a"} Jun 02 18:49:22.011032 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:22.010710 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:22.036419 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:22.036360 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" podStartSLOduration=1.605248837 podStartE2EDuration="7.036343396s" podCreationTimestamp="2026-06-02 18:49:15 +0000 UTC" firstStartedPulling="2026-06-02 18:49:16.384598003 +0000 UTC m=+567.920426790" lastFinishedPulling="2026-06-02 18:49:21.81569255 +0000 UTC m=+573.351521349" observedRunningTime="2026-06-02 18:49:22.032894793 +0000 UTC m=+573.568723585" watchObservedRunningTime="2026-06-02 18:49:22.036343396 +0000 UTC m=+573.572172205" Jun 02 18:49:28.045968 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:28.045932 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-tl7lh" Jun 02 18:49:41.360227 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.360189 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-q4cp5"] Jun 02 18:49:41.363636 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.363617 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" Jun 02 18:49:41.368110 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.368091 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 18:49:41.369311 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.369295 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-b6cf7\"" Jun 02 18:49:41.369402 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.369295 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 18:49:41.406078 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.406043 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-q4cp5"] Jun 02 18:49:41.530801 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.530731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6v8\" (UniqueName: \"kubernetes.io/projected/6b7e27c9-5b2a-4642-86aa-daca18d5da38-kube-api-access-kd6v8\") pod \"keycloak-operator-7864d68cbd-q4cp5\" (UID: \"6b7e27c9-5b2a-4642-86aa-daca18d5da38\") " pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" Jun 02 18:49:41.631462 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.631366 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6v8\" (UniqueName: \"kubernetes.io/projected/6b7e27c9-5b2a-4642-86aa-daca18d5da38-kube-api-access-kd6v8\") pod \"keycloak-operator-7864d68cbd-q4cp5\" (UID: \"6b7e27c9-5b2a-4642-86aa-daca18d5da38\") " pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" Jun 02 18:49:41.647674 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.647647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6v8\" (UniqueName: \"kubernetes.io/projected/6b7e27c9-5b2a-4642-86aa-daca18d5da38-kube-api-access-kd6v8\") pod \"keycloak-operator-7864d68cbd-q4cp5\" (UID: \"6b7e27c9-5b2a-4642-86aa-daca18d5da38\") " pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" Jun 02 18:49:41.673595 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.673563 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" Jun 02 18:49:41.866096 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:41.866062 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-q4cp5"] Jun 02 18:49:41.869455 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:49:41.869425 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7e27c9_5b2a_4642_86aa_daca18d5da38.slice/crio-ccfd61fea99c4e1ac945013a2b7195d6079a57c268626a2a440dfa6b5880bbc0 WatchSource:0}: Error finding container ccfd61fea99c4e1ac945013a2b7195d6079a57c268626a2a440dfa6b5880bbc0: Status 404 returned error can't find the container with id ccfd61fea99c4e1ac945013a2b7195d6079a57c268626a2a440dfa6b5880bbc0 Jun 02 18:49:42.078464 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:42.078427 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" event={"ID":"6b7e27c9-5b2a-4642-86aa-daca18d5da38","Type":"ContainerStarted","Data":"ccfd61fea99c4e1ac945013a2b7195d6079a57c268626a2a440dfa6b5880bbc0"} Jun 02 18:49:48.101375 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:48.101334 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" event={"ID":"6b7e27c9-5b2a-4642-86aa-daca18d5da38","Type":"ContainerStarted","Data":"1f13fabeb730148481fa6a5f0d985fbe98f81cbae6dfaa2055b631ed6ffcc119"} Jun 02 18:49:48.163007 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:49:48.162883 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-q4cp5" podStartSLOduration=1.149661175 podStartE2EDuration="7.162867418s" podCreationTimestamp="2026-06-02 18:49:41 +0000 UTC" firstStartedPulling="2026-06-02 18:49:41.870955508 +0000 UTC m=+593.406784296" lastFinishedPulling="2026-06-02 18:49:47.884161749 +0000 UTC m=+599.419990539" observedRunningTime="2026-06-02 18:49:48.161638959 +0000 UTC m=+599.697467768" watchObservedRunningTime="2026-06-02 18:49:48.162867418 +0000 UTC m=+599.698696227" Jun 02 18:51:10.261590 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.261558 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m62zn"] Jun 02 18:51:10.264872 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.264855 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:10.271012 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.270983 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fm8l7\"" Jun 02 18:51:10.271141 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.270983 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 18:51:10.289949 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.289917 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m62zn"] Jun 02 18:51:10.404298 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.404265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9wjs\" (UniqueName: \"kubernetes.io/projected/873795a8-7470-4a6d-910d-34dfc8c3ca0d-kube-api-access-v9wjs\") pod \"payload-processing-58b6c8fdc7-m62zn\" (UID: \"873795a8-7470-4a6d-910d-34dfc8c3ca0d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:10.505231 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.505192 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9wjs\" (UniqueName: \"kubernetes.io/projected/873795a8-7470-4a6d-910d-34dfc8c3ca0d-kube-api-access-v9wjs\") pod \"payload-processing-58b6c8fdc7-m62zn\" (UID: \"873795a8-7470-4a6d-910d-34dfc8c3ca0d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:10.518061 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.517991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9wjs\" (UniqueName: \"kubernetes.io/projected/873795a8-7470-4a6d-910d-34dfc8c3ca0d-kube-api-access-v9wjs\") pod \"payload-processing-58b6c8fdc7-m62zn\" (UID: \"873795a8-7470-4a6d-910d-34dfc8c3ca0d\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:10.575025 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.574983 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:10.719596 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.719564 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-m62zn"] Jun 02 18:51:10.721970 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:51:10.721929 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873795a8_7470_4a6d_910d_34dfc8c3ca0d.slice/crio-172273c073845a90a85b2fd1a21cc6a9abc23794fa054fab536fd75df9c1d631 WatchSource:0}: Error finding container 172273c073845a90a85b2fd1a21cc6a9abc23794fa054fab536fd75df9c1d631: Status 404 returned error can't find the container with id 172273c073845a90a85b2fd1a21cc6a9abc23794fa054fab536fd75df9c1d631 Jun 02 18:51:10.724009 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:10.723989 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:51:11.401797 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:11.401708 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" event={"ID":"873795a8-7470-4a6d-910d-34dfc8c3ca0d","Type":"ContainerStarted","Data":"172273c073845a90a85b2fd1a21cc6a9abc23794fa054fab536fd75df9c1d631"} Jun 02 18:51:14.415163 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:14.415123 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" event={"ID":"873795a8-7470-4a6d-910d-34dfc8c3ca0d","Type":"ContainerStarted","Data":"c8c175a0459a30e6faf86c1900089b4979f3dde2cf6a51fb5730c0b03ba6aedd"} Jun 02 18:51:14.415597 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:14.415184 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:25.420986 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:25.420953 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" Jun 02 18:51:25.454924 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:51:25.454865 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-m62zn" podStartSLOduration=12.760620652 podStartE2EDuration="15.454850522s" podCreationTimestamp="2026-06-02 18:51:10 +0000 UTC" firstStartedPulling="2026-06-02 18:51:10.724117918 +0000 UTC m=+682.259946706" lastFinishedPulling="2026-06-02 18:51:13.418347778 +0000 UTC m=+684.954176576" observedRunningTime="2026-06-02 18:51:14.44869845 +0000 UTC m=+685.984527261" watchObservedRunningTime="2026-06-02 18:51:25.454850522 +0000 UTC m=+696.990679332" Jun 02 18:52:49.515815 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.515763 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch"] Jun 02 18:52:49.519383 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.519359 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.522778 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.522728 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qgnlc\"" Jun 02 18:52:49.523785 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.523582 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 18:52:49.524586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.524470 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 18:52:49.524586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.524499 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 18:52:49.529302 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.529277 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch"] Jun 02 18:52:49.590022 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.589976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hhvb\" (UniqueName: \"kubernetes.io/projected/cdef424f-84b7-4439-b15c-b20d51065f17-kube-api-access-4hhvb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.590204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.590062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.590204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.590109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.590204 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.590192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdef424f-84b7-4439-b15c-b20d51065f17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.590329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.590231 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.590329 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.590271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690627 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690587 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690627 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690633 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690666 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdef424f-84b7-4439-b15c-b20d51065f17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690690 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690711 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.690905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.690728 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hhvb\" (UniqueName: \"kubernetes.io/projected/cdef424f-84b7-4439-b15c-b20d51065f17-kube-api-access-4hhvb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.691173 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.691142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.691263 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.691195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.691263 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.691246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.693297 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.693268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdef424f-84b7-4439-b15c-b20d51065f17-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.693434 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.693417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdef424f-84b7-4439-b15c-b20d51065f17-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.699416 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.699393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hhvb\" (UniqueName: \"kubernetes.io/projected/cdef424f-84b7-4439-b15c-b20d51065f17-kube-api-access-4hhvb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch\" (UID: \"cdef424f-84b7-4439-b15c-b20d51065f17\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.832728 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.832688 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:49.972918 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:49.972891 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch"] Jun 02 18:52:49.975333 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:52:49.975305 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdef424f_84b7_4439_b15c_b20d51065f17.slice/crio-f789cff5d3ca62e5280b50703f9fb4d0529e0fc565bb96851b9e9c3b6b09495a WatchSource:0}: Error finding container f789cff5d3ca62e5280b50703f9fb4d0529e0fc565bb96851b9e9c3b6b09495a: Status 404 returned error can't find the container with id f789cff5d3ca62e5280b50703f9fb4d0529e0fc565bb96851b9e9c3b6b09495a Jun 02 18:52:50.766912 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:50.766873 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" event={"ID":"cdef424f-84b7-4439-b15c-b20d51065f17","Type":"ContainerStarted","Data":"f789cff5d3ca62e5280b50703f9fb4d0529e0fc565bb96851b9e9c3b6b09495a"} Jun 02 18:52:53.780608 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:53.780575 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" event={"ID":"cdef424f-84b7-4439-b15c-b20d51065f17","Type":"ContainerStarted","Data":"41d312241d79cbbc5d770557f313086111ef31c462e26902ba1e60cccaa24d36"} Jun 02 18:52:54.785763 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:54.785709 2564 generic.go:358] "Generic (PLEG): container finished" podID="cdef424f-84b7-4439-b15c-b20d51065f17" containerID="41d312241d79cbbc5d770557f313086111ef31c462e26902ba1e60cccaa24d36" exitCode=0 Jun 02 18:52:54.786119 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:54.785777 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" event={"ID":"cdef424f-84b7-4439-b15c-b20d51065f17","Type":"ContainerDied","Data":"41d312241d79cbbc5d770557f313086111ef31c462e26902ba1e60cccaa24d36"} Jun 02 18:52:56.795281 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:56.795245 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" event={"ID":"cdef424f-84b7-4439-b15c-b20d51065f17","Type":"ContainerStarted","Data":"8e9914ac612273d9a6836b6b7e8d278fb6b6ac01c4882f9ae24cbeee632a5206"} Jun 02 18:52:56.816166 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:56.816111 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" podStartSLOduration=1.935193259 podStartE2EDuration="7.81609645s" podCreationTimestamp="2026-06-02 18:52:49 +0000 UTC" firstStartedPulling="2026-06-02 18:52:49.977480479 +0000 UTC m=+781.513309269" lastFinishedPulling="2026-06-02 18:52:55.858383672 +0000 UTC m=+787.394212460" observedRunningTime="2026-06-02 18:52:56.81315447 +0000 UTC m=+788.348983283" watchObservedRunningTime="2026-06-02 18:52:56.81609645 +0000 UTC m=+788.351925261" Jun 02 18:52:59.833124 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:59.833083 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:59.833124 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:59.833128 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:52:59.845895 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:52:59.845864 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:53:00.828490 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:53:00.828452 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch" Jun 02 18:59:20.396190 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:20.396155 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8d496bf45-kbrb5_f458590e-98d8-41f2-b196-922b0e773a61/nginx/0.log" Jun 02 18:59:20.611450 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:20.611403 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gccm5_05f7772e-7970-4b2d-8832-57a588c6cc4d/manager/0.log" Jun 02 18:59:20.725478 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:20.725397 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-mtnwz_18c64980-0d64-4342-bc4d-1788834c9bd8/manager/0.log" Jun 02 18:59:21.066233 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:21.066205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-4vpfr_7d2316de-313e-4aab-9b70-131a315cfb3c/server/0.log" Jun 02 18:59:21.173650 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:21.173613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-x87qh_60d29a75-dc25-4d10-a335-30f383a7303e/manager/0.log" Jun 02 18:59:21.413415 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:21.413329 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-nhwd2_a7b74e3d-7cb3-47c5-b867-7c46f050e0c0/copy-manifests/0.log" Jun 02 18:59:21.421342 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:21.421320 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-nhwd2_a7b74e3d-7cb3-47c5-b867-7c46f050e0c0/manager/0.log" Jun 02 18:59:21.643004 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:21.642976 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-tl7lh_877b631d-47d0-4fb3-9f9c-6e5fe6d742e9/postgres/0.log" Jun 02 18:59:23.101380 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:23.101348 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5zpvc_701691ce-795e-4317-88dd-e56a647ffe71/manager/0.log" Jun 02 18:59:24.115661 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:24.115629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-8pr2h_dbbe9906-2cb0-411b-a557-14ebd510cbea/discovery/0.log" Jun 02 18:59:24.218749 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:24.218704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6c8b7568-grv6j_e13af72a-3842-48d3-88ae-58142362ec2f/kube-auth-proxy/0.log" Jun 02 18:59:24.441179 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:24.441082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-4r9jc_e2c3d8de-f33a-45b8-8a21-df35a1ad00d6/istio-proxy/0.log" Jun 02 18:59:24.549821 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:24.549789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-m62zn_873795a8-7470-4a6d-910d-34dfc8c3ca0d/payload-processing/0.log" Jun 02 18:59:25.327867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:25.327835 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch_cdef424f-84b7-4439-b15c-b20d51065f17/storage-initializer/0.log" Jun 02 18:59:25.335592 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:25.335565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97n9ch_cdef424f-84b7-4439-b15c-b20d51065f17/main/0.log" Jun 02 18:59:32.789183 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:32.789141 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rqdpc_870bf59a-2027-4784-9c35-304abb350c2c/global-pull-secret-syncer/0.log" Jun 02 18:59:32.867411 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:32.867381 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdth9_06b70537-26d2-4c9c-b096-9091685db56e/konnectivity-agent/0.log" Jun 02 18:59:32.912126 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:32.912086 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-123.ec2.internal_131ee351bb55ad6be954235ac6b9f987/haproxy/0.log" Jun 02 18:59:37.122194 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:37.122164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5zpvc_701691ce-795e-4317-88dd-e56a647ffe71/manager/0.log" Jun 02 18:59:38.957320 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:38.957291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vfwvw_8b67ab23-7a2a-469d-8968-191398d0d89c/kube-state-metrics/0.log" Jun 02 18:59:38.994753 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:38.994710 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vfwvw_8b67ab23-7a2a-469d-8968-191398d0d89c/kube-rbac-proxy-main/0.log" Jun 02 18:59:39.017576 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.017544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vfwvw_8b67ab23-7a2a-469d-8968-191398d0d89c/kube-rbac-proxy-self/0.log" Jun 02 18:59:39.054440 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.054388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8bb89bf9-dxn5g_5cd98ba5-a27c-42f7-909b-100eac56e3f5/metrics-server/0.log" Jun 02 18:59:39.220677 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.220593 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9g6cp_653464cd-0d47-446e-9a33-5cd142b4fb67/node-exporter/0.log" Jun 02 18:59:39.249616 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.249590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9g6cp_653464cd-0d47-446e-9a33-5cd142b4fb67/kube-rbac-proxy/0.log" Jun 02 18:59:39.274192 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.274166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9g6cp_653464cd-0d47-446e-9a33-5cd142b4fb67/init-textfile/0.log" Jun 02 18:59:39.850884 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.850849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/thanos-query/0.log" Jun 02 18:59:39.872434 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.872396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/kube-rbac-proxy-web/0.log" Jun 02 18:59:39.894838 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.894809 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/kube-rbac-proxy/0.log" Jun 02 18:59:39.917077 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.917051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/prom-label-proxy/0.log" Jun 02 18:59:39.940256 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.940227 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/kube-rbac-proxy-rules/0.log" Jun 02 18:59:39.963799 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:39.963772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc79f4b54-kpsjl_50bf3ef4-5a2b-45a4-94f1-e69585be16d9/kube-rbac-proxy-metrics/0.log" Jun 02 18:59:42.573007 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.572969 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w"] Jun 02 18:59:42.576412 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.576388 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.579573 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.579551 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"kube-root-ca.crt\"" Jun 02 18:59:42.579750 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.579626 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"openshift-service-ca.crt\"" Jun 02 18:59:42.580927 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.580911 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w4k8q\"/\"default-dockercfg-tfwvc\"" Jun 02 18:59:42.586341 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.586321 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w"] Jun 02 18:59:42.728812 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.728767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-lib-modules\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.729019 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.728856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-proc\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.729019 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.728882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjm5f\" (UniqueName: \"kubernetes.io/projected/39acc723-5d29-4000-8c62-c3e7c768adad-kube-api-access-qjm5f\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.729019 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.728933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-podres\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.729019 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.728984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-sys\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830074 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.829978 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-podres\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830074 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830043 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-sys\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830080 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-lib-modules\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830130 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-proc\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830152 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjm5f\" (UniqueName: \"kubernetes.io/projected/39acc723-5d29-4000-8c62-c3e7c768adad-kube-api-access-qjm5f\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-podres\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-sys\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-lib-modules\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.830571 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.830358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39acc723-5d29-4000-8c62-c3e7c768adad-proc\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.839867 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.839842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjm5f\" (UniqueName: \"kubernetes.io/projected/39acc723-5d29-4000-8c62-c3e7c768adad-kube-api-access-qjm5f\") pod \"perf-node-gather-daemonset-qbb5w\" (UID: \"39acc723-5d29-4000-8c62-c3e7c768adad\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:42.887823 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:42.887787 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:43.028404 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.028370 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w"] Jun 02 18:59:43.031462 ip-10-0-128-123 kubenswrapper[2564]: W0602 18:59:43.031428 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39acc723_5d29_4000_8c62_c3e7c768adad.slice/crio-048ce8aa81de255ef3245e3e2ae0ff8c3f41bf24eed927639150cea95492ae63 WatchSource:0}: Error finding container 048ce8aa81de255ef3245e3e2ae0ff8c3f41bf24eed927639150cea95492ae63: Status 404 returned error can't find the container with id 048ce8aa81de255ef3245e3e2ae0ff8c3f41bf24eed927639150cea95492ae63 Jun 02 18:59:43.033421 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.033402 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:59:43.268089 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.268051 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" event={"ID":"39acc723-5d29-4000-8c62-c3e7c768adad","Type":"ContainerStarted","Data":"75110f6f52f0bf2b9de9f2e1f1aff7b89a2e5207dc813e1838e7620503224430"} Jun 02 18:59:43.268089 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.268095 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" event={"ID":"39acc723-5d29-4000-8c62-c3e7c768adad","Type":"ContainerStarted","Data":"048ce8aa81de255ef3245e3e2ae0ff8c3f41bf24eed927639150cea95492ae63"} Jun 02 18:59:43.268303 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.268218 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:43.286446 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.286370 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" podStartSLOduration=1.286355411 podStartE2EDuration="1.286355411s" podCreationTimestamp="2026-06-02 18:59:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:59:43.285384957 +0000 UTC m=+1194.821213769" watchObservedRunningTime="2026-06-02 18:59:43.286355411 +0000 UTC m=+1194.822184222" Jun 02 18:59:43.604214 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.604186 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5szk_8b757491-e6d2-4191-ad6d-cee837dbd02b/dns/0.log" Jun 02 18:59:43.625586 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.625558 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5szk_8b757491-e6d2-4191-ad6d-cee837dbd02b/kube-rbac-proxy/0.log" Jun 02 18:59:43.715439 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:43.715407 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jsg4n_22ddbfe5-c169-451c-b9ca-6425ea01c22a/dns-node-resolver/0.log" Jun 02 18:59:44.259059 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:44.259029 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4dvvc_ef36ec2d-05d8-4c25-b086-d4d248941fa1/node-ca/0.log" Jun 02 18:59:45.204273 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:45.204240 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-8pr2h_dbbe9906-2cb0-411b-a557-14ebd510cbea/discovery/0.log" Jun 02 18:59:45.223328 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:45.223308 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6c8b7568-grv6j_e13af72a-3842-48d3-88ae-58142362ec2f/kube-auth-proxy/0.log" Jun 02 18:59:45.274076 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:45.274041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-4r9jc_e2c3d8de-f33a-45b8-8a21-df35a1ad00d6/istio-proxy/0.log" Jun 02 18:59:45.296484 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:45.296456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-m62zn_873795a8-7470-4a6d-910d-34dfc8c3ca0d/payload-processing/0.log" Jun 02 18:59:45.834028 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:45.833997 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8nx9h_4cb8dd1f-abce-4d90-804a-3b97495e745e/serve-healthcheck-canary/0.log" Jun 02 18:59:46.471520 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:46.471491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6jck_1e5d9032-ca56-4eaf-9e89-5140e09b76a0/kube-rbac-proxy/0.log" Jun 02 18:59:46.493095 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:46.493073 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6jck_1e5d9032-ca56-4eaf-9e89-5140e09b76a0/exporter/0.log" Jun 02 18:59:46.519905 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:46.519872 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6jck_1e5d9032-ca56-4eaf-9e89-5140e09b76a0/extractor/0.log" Jun 02 18:59:48.524274 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.524243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8d496bf45-kbrb5_f458590e-98d8-41f2-b196-922b0e773a61/nginx/0.log" Jun 02 18:59:48.575952 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.575925 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gccm5_05f7772e-7970-4b2d-8832-57a588c6cc4d/manager/0.log" Jun 02 18:59:48.606961 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.606934 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-mtnwz_18c64980-0d64-4342-bc4d-1788834c9bd8/manager/0.log" Jun 02 18:59:48.677385 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.677360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-4vpfr_7d2316de-313e-4aab-9b70-131a315cfb3c/server/0.log" Jun 02 18:59:48.721656 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.721628 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-x87qh_60d29a75-dc25-4d10-a335-30f383a7303e/manager/0.log" Jun 02 18:59:48.884991 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.884965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-nhwd2_a7b74e3d-7cb3-47c5-b867-7c46f050e0c0/manager/0.log" Jun 02 18:59:48.904857 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.904832 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-nhwd2_a7b74e3d-7cb3-47c5-b867-7c46f050e0c0/copy-manifests/0.log" Jun 02 18:59:48.978050 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:48.978023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-tl7lh_877b631d-47d0-4fb3-9f9c-6e5fe6d742e9/postgres/0.log" Jun 02 18:59:49.282913 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:49.282882 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-qbb5w" Jun 02 18:59:50.322271 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:50.322234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-dbc4k_9d41cac3-00e8-41e6-bc47-f88f7edf25f7/openshift-lws-operator/0.log" Jun 02 18:59:56.719224 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.719193 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/kube-multus-additional-cni-plugins/0.log" Jun 02 18:59:56.739125 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.739094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/egress-router-binary-copy/0.log" Jun 02 18:59:56.758336 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.758305 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/cni-plugins/0.log" Jun 02 18:59:56.779105 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.779079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/bond-cni-plugin/0.log" Jun 02 18:59:56.797661 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.797632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/routeoverride-cni/0.log" Jun 02 18:59:56.818246 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.818221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/whereabouts-cni-bincopy/0.log" Jun 02 18:59:56.839975 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:56.839949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpgk4_6136ed07-28f6-428f-a671-9c65e8a8343b/whereabouts-cni/0.log" Jun 02 18:59:57.020919 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:57.020820 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-db4bd_579c7e8d-38ca-4c40-9992-8dfc4d562bd5/kube-multus/0.log" Jun 02 18:59:57.140160 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:57.140129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jq5kp_d8450680-f5e4-45f1-bca1-1cc13fd0ddd1/network-metrics-daemon/0.log" Jun 02 18:59:57.160437 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:57.160411 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jq5kp_d8450680-f5e4-45f1-bca1-1cc13fd0ddd1/kube-rbac-proxy/0.log" Jun 02 18:59:58.436513 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.436436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/ovn-controller/0.log" Jun 02 18:59:58.466246 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.466217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/ovn-acl-logging/0.log" Jun 02 18:59:58.500673 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.500619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/kube-rbac-proxy-node/0.log" Jun 02 18:59:58.524954 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.524926 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 18:59:58.547511 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.547486 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/northd/0.log" Jun 02 18:59:58.569252 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.569226 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/nbdb/0.log" Jun 02 18:59:58.590092 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.590061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/sbdb/0.log" Jun 02 18:59:58.685468 ip-10-0-128-123 kubenswrapper[2564]: I0602 18:59:58.685435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzl2v_cca77f4f-c89f-4c40-80c8-fc99853e8f87/ovnkube-controller/0.log"