Jun 03 15:00:55.393862 ip-10-0-133-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:00:55.393873 ip-10-0-133-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:00:55.393880 ip-10-0-133-25 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:00:55.394095 ip-10-0-133-25 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:01:06.601071 ip-10-0-133-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:01:06.601085 ip-10-0-133-25 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 91d633fef26844df9a50ffa6aff664a2 -- Jun 03 15:03:39.743419 ip-10-0-133-25 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:03:40.264198 ip-10-0-133-25 kubenswrapper[2527]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:40.264198 ip-10-0-133-25 kubenswrapper[2527]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:03:40.264198 ip-10-0-133-25 kubenswrapper[2527]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:40.264198 ip-10-0-133-25 kubenswrapper[2527]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:03:40.264198 ip-10-0-133-25 kubenswrapper[2527]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:40.268267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.268181 2527 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275781 2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275799 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275803 2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275807 2527 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275810 2527 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:40.275806 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275813 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275817 2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275820 2527 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275823 2527 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275826 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275828 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275831 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275834 2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275837 2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275840 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275842 2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275845 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275848 2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275850 2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275853 2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275855 2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275858 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275860 2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275863 2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275865 2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:40.276025 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275868 2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275870 2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275883 2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275888 2527 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275890 2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275893 2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275896 2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275898 2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275901 2527 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275903 2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275906 2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275908 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275911 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275914 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275918 2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275920 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275923 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275926 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275929 2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275931 2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:40.276499 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275934 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275936 2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275939 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275941 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275944 2527 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275946 2527 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275948 2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275951 2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275954 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275956 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275959 2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275961 2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275964 2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275967 2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275971 2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275974 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275976 2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275979 2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275982 2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:40.276995 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275984 2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275988 2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275990 2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275993 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275996 2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.275998 2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276001 2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276003 2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276006 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276008 2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276011 2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276013 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276016 2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276018 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276021 2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276024 2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276026 2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276029 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276032 2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276034 2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:40.277491 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276037 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276039 2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276427 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276432 2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276435 2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276438 2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276440 2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276443 2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276445 2527 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276447 2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276450 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276455 2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276459 2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276462 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276465 2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276468 2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276470 2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276473 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276476 2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:40.277969 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276479 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276481 2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276484 2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276486 2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276488 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276491 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276493 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276500 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276504 2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276506 2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276509 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276511 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276514 2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276516 2527 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276519 2527 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276521 2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276524 2527 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276526 2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276528 2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276533 2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:40.278431 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276536 2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276539 2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276542 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276545 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276548 2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276568 2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276571 2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276575 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276578 2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276580 2527 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276583 2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276586 2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276588 2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276590 2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276593 2527 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276595 2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276598 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276600 2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276602 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276605 2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:40.278908 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276608 2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276611 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276613 2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276615 2527 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276618 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276620 2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276623 2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276625 2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276628 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276630 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276632 2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276635 2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276637 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276639 2527 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276642 2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276645 2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276648 2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276652 2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276654 2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276657 2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:40.279405 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276659 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276662 2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276664 2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276667 2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276669 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276671 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276674 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276676 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.276678 2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277401 2527 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277409 2527 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277415 2527 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277419 2527 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277424 2527 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277427 2527 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277431 2527 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277436 2527 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277439 2527 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277442 2527 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277445 2527 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277448 2527 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277451 2527 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:03:40.279910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277454 2527 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277457 2527 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277460 2527 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277463 2527 flags.go:64] FLAG: --cloud-config="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277465 2527 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277469 2527 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277474 2527 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277477 2527 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277480 2527 flags.go:64] FLAG: --config-dir="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277483 2527 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277486 2527 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277490 2527 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277493 2527 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277497 2527 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277500 2527 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277503 2527 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277506 2527 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277509 2527 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277512 2527 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277515 2527 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277519 2527 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277521 2527 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277524 2527 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277527 2527 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277531 2527 flags.go:64] FLAG: --enable-server="true" Jun 03 15:03:40.280525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277534 2527 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277538 2527 flags.go:64] FLAG: --event-burst="100" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277541 2527 flags.go:64] FLAG: --event-qps="50" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277544 2527 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277547 2527 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277550 2527 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277554 2527 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277556 2527 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277559 2527 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277562 2527 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277565 2527 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277568 2527 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277571 2527 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277574 2527 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277577 2527 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277580 2527 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277582 2527 flags.go:64] FLAG: --feature-gates="" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277586 2527 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277589 2527 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277592 2527 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277595 2527 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277598 2527 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277601 2527 flags.go:64] FLAG: --help="false" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277603 2527 flags.go:64] FLAG: --hostname-override="ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277606 2527 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:03:40.281141 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277609 2527 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277612 2527 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277615 2527 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277618 2527 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277621 2527 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277623 2527 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277626 2527 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277629 2527 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277632 2527 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277635 2527 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277638 2527 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277641 2527 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277643 2527 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277647 2527 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277649 2527 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277652 2527 flags.go:64] FLAG: --lock-file="" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277654 2527 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277657 2527 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277660 2527 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277665 2527 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277668 2527 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277671 2527 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277674 2527 flags.go:64] FLAG: --logging-format="text" Jun 03 15:03:40.281714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277677 2527 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277680 2527 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277683 2527 flags.go:64] FLAG: --manifest-url="" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277685 2527 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277689 2527 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277692 2527 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277696 2527 flags.go:64] FLAG: --max-pods="110" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277699 2527 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277702 2527 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277704 2527 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277707 2527 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277710 2527 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277713 2527 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277716 2527 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277723 2527 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277725 2527 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277728 2527 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277732 2527 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277735 2527 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277740 2527 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277742 2527 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277747 2527 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277750 2527 flags.go:64] FLAG: --port="10250" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277753 2527 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:03:40.282312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277756 2527 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd7538f0b957b783" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277759 2527 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277762 2527 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277764 2527 flags.go:64] FLAG: --register-node="true" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277767 2527 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277770 2527 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277774 2527 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277776 2527 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277779 2527 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277782 2527 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277785 2527 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277788 2527 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277791 2527 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277794 2527 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277797 2527 flags.go:64] FLAG: --runonce="false" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277799 2527 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277802 2527 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277805 2527 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277808 2527 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277811 2527 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277813 2527 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277816 2527 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277819 2527 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277822 2527 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277824 2527 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277827 2527 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:03:40.282875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277830 2527 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277833 2527 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277836 2527 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277840 2527 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277845 2527 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277847 2527 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277850 2527 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277854 2527 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277857 2527 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277860 2527 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277863 2527 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277865 2527 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277868 2527 flags.go:64] FLAG: --v="2" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277872 2527 flags.go:64] FLAG: --version="false" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277876 2527 flags.go:64] FLAG: --vmodule="" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277881 2527 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.277884 2527 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277977 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277981 2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277984 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277987 2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277991 2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277994 2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:40.283506 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277996 2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.277999 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278001 2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278004 2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278006 2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278009 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278011 2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278014 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278016 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278018 2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278021 2527 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278024 2527 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278028 2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278030 2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278033 2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278035 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278038 2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278040 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278042 2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278046 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:40.284080 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278049 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278051 2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278054 2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278056 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278058 2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278061 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278063 2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278066 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278068 2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278071 2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278073 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278076 2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278078 2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278080 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278083 2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278085 2527 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278088 2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278090 2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278092 2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278095 2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:40.284588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278097 2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278100 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278103 2527 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278106 2527 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278110 2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278112 2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278115 2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278117 2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278120 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278122 2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278124 2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278145 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278148 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278150 2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278153 2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278155 2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278157 2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278160 2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278163 2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278165 2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:40.285072 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278168 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278170 2527 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278173 2527 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278175 2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278178 2527 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278180 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278183 2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278185 2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278188 2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278191 2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278193 2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278195 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278198 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278202 2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278205 2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278208 2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278213 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278216 2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278219 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:40.285564 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.278222 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:40.286020 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.279092 2527 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:40.286338 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.286319 2527 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:03:40.286369 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.286339 2527 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:03:40.286400 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286390 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:40.286400 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286396 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:40.286400 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286399 2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286403 2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286406 2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286409 2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286412 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286415 2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286418 2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286421 2527 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286424 2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286427 2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286429 2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286432 2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286436 2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286439 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286442 2527 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286445 2527 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286447 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286449 2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286452 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286455 2527 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:40.286475 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286457 2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286460 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286462 2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286465 2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286468 2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286471 2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286473 2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286476 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286478 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286481 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286484 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286487 2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286490 2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286492 2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286495 2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286497 2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286500 2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286502 2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286504 2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:40.286943 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286507 2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286509 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286512 2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286514 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286517 2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286519 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286521 2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286524 2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286526 2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286529 2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286531 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286534 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286536 2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286539 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286541 2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286544 2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286547 2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286550 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286553 2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:40.287421 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286555 2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286559 2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286563 2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286566 2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286568 2527 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286571 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286574 2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286576 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286579 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286582 2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286584 2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286587 2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286590 2527 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286592 2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286595 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286597 2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286600 2527 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286602 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286605 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286607 2527 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:40.287903 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286610 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286614 2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286616 2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286619 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286621 2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286624 2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.286629 2527 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286736 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286741 2527 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286744 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286747 2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286750 2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286753 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286755 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286758 2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:40.288392 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286760 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286762 2527 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286765 2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286767 2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286770 2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286772 2527 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286774 2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286777 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286780 2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286782 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286785 2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286787 2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286790 2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286792 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286795 2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286797 2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286799 2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286802 2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286804 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286807 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:40.288767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286809 2527 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286811 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286814 2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286816 2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286818 2527 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286821 2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286823 2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286826 2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286829 2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286837 2527 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286840 2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286842 2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286844 2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286846 2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286849 2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286851 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286854 2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286856 2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286858 2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286861 2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:40.289287 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286863 2527 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286866 2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286868 2527 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286870 2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286873 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286875 2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286878 2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286880 2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286884 2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286887 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286890 2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286892 2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286895 2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286898 2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286900 2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286903 2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286905 2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286908 2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286911 2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:40.289767 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286913 2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286915 2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286918 2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286926 2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286929 2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286933 2527 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286935 2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286938 2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286940 2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286943 2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286945 2527 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286948 2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286950 2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286953 2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286956 2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286958 2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286961 2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286963 2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:40.290323 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:40.286965 2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:40.290755 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.286969 2527 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:40.290755 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.287860 2527 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:03:40.291836 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.291822 2527 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:03:40.292846 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.292834 2527 server.go:1019] "Starting client certificate rotation" Jun 03 15:03:40.292946 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.292929 2527 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:03:40.292976 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.292966 2527 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:03:40.326854 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.326836 2527 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:03:40.331662 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.331644 2527 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:03:40.344063 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.344045 2527 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:03:40.350056 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.350038 2527 log.go:25] "Validated CRI v1 image API" Jun 03 15:03:40.357178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.357152 2527 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:03:40.363659 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.363636 2527 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d20e60f0-7fdf-424c-8813-5200f3f5775e:/dev/nvme0n1p4 f89342d9-1440-452d-b385-c49a65a08626:/dev/nvme0n1p3] Jun 03 15:03:40.363728 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.363658 2527 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:03:40.367875 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.367774 2527 manager.go:217] Machine: {Timestamp:2026-06-03 15:03:40.36729533 +0000 UTC m=+0.500584241 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200379 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec252ae51d50666f2b88040dbe919ddc SystemUUID:ec252ae5-1d50-666f-2b88-040dbe919ddc BootID:91d633fe-f268-44df-9a50-ffa6aff664a2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:d2:55:7d:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:d2:55:7d:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:47:11:43:9f:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:03:40.368609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.368599 2527 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:03:40.368701 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.368685 2527 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:03:40.373312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.373283 2527 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:03:40.373443 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.373315 2527 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:03:40.373490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.373450 2527 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:03:40.373490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.373459 2527 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:03:40.373490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.373465 2527 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:03:40.374326 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.374315 2527 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:03:40.375305 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.375293 2527 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:03:40.375414 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.375406 2527 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:03:40.377252 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377237 2527 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:03:40.377801 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377791 2527 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:03:40.377833 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377805 2527 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:03:40.377833 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377817 2527 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:03:40.377833 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377829 2527 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:03:40.377926 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.377838 2527 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:03:40.379179 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.379167 2527 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:03:40.379214 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.379189 2527 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:03:40.383029 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.383012 2527 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:03:40.387950 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.387928 2527 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:03:40.390228 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390214 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:03:40.390228 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390231 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390237 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390243 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390251 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390257 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390262 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390267 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390274 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390281 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390288 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:03:40.390335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.390295 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:03:40.391312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.391297 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:03:40.391312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.391311 2527 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:03:40.394499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.394486 2527 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:03:40.394564 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.394519 2527 server.go:1295] "Started kubelet" Jun 03 15:03:40.394600 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.394579 2527 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:03:40.394645 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.394602 2527 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:03:40.394684 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.394666 2527 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:03:40.395223 ip-10-0-133-25 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:03:40.397169 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.397154 2527 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:03:40.397324 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.397311 2527 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:03:40.398745 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.398731 2527 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:03:40.399601 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.399579 2527 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:03:40.399668 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.399581 2527 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:03:40.409624 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.408089 2527 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-25.ec2.internal.18b59a6cf18b8573 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-25.ec2.internal,UID:ip-10-0-133-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-25.ec2.internal,},FirstTimestamp:2026-06-03 15:03:40.394497395 +0000 UTC m=+0.527786285,LastTimestamp:2026-06-03 15:03:40.394497395 +0000 UTC m=+0.527786285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-25.ec2.internal,}" Jun 03 15:03:40.410920 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.410901 2527 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:03:40.411899 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.411882 2527 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:03:40.411964 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.411952 2527 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:03:40.411964 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.411963 2527 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:03:40.412179 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412161 2527 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:03:40.412243 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412228 2527 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:03:40.412243 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412238 2527 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:03:40.412723 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412699 2527 factory.go:153] Registering CRI-O factory Jun 03 15:03:40.412723 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412718 2527 factory.go:223] Registration of the crio container factory successfully Jun 03 15:03:40.412820 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412761 2527 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:03:40.412820 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412769 2527 factory.go:55] Registering systemd factory Jun 03 15:03:40.412820 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412775 2527 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:03:40.412820 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412793 2527 factory.go:103] Registering Raw factory Jun 03 15:03:40.412820 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.412812 2527 manager.go:1196] Started watching for new ooms in manager Jun 03 15:03:40.413146 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.413101 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.413146 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.413111 2527 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:03:40.413286 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.413273 2527 manager.go:319] Starting recovery of all containers Jun 03 15:03:40.424648 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.424540 2527 manager.go:324] Recovery completed Jun 03 15:03:40.425305 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.425282 2527 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:03:40.425305 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.425293 2527 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:03:40.425851 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.425836 2527 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7x9fv" Jun 03 15:03:40.428635 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.428622 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.430661 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.430646 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.430720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.430673 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.430720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.430683 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.431210 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.431195 2527 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:03:40.431210 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.431209 2527 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:03:40.431343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.431227 2527 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:03:40.435010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.434994 2527 policy_none.go:49] "None policy: Start" Jun 03 15:03:40.435010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.435011 2527 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:03:40.435169 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.435022 2527 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:03:40.437604 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.437590 2527 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7x9fv" Jun 03 15:03:40.470732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.470714 2527 manager.go:341] "Starting Device Plugin manager" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.470743 2527 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.470752 2527 server.go:85] "Starting device plugin registration server" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.470968 2527 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.470994 2527 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.471091 2527 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.471219 2527 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.471232 2527 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.471686 2527 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:03:40.484971 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.471721 2527 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.539511 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.539431 2527 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:03:40.540764 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.540744 2527 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:03:40.540853 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.540771 2527 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:03:40.540853 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.540794 2527 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:03:40.540853 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.540803 2527 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:03:40.540853 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.540847 2527 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:03:40.544897 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.544880 2527 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:40.571783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.571762 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.572640 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.572625 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.572725 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.572653 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.572725 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.572664 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.572725 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.572685 2527 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.587062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.587044 2527 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.587150 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.587066 2527 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-25.ec2.internal\": node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.641210 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.641181 2527 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal"] Jun 03 15:03:40.641305 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.641247 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.642698 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.642683 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.642773 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.642709 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.642773 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.642718 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.643996 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.643979 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.644104 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644089 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.644162 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644119 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.644708 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644690 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.644785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644693 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.644785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644740 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.644785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644756 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.644785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644718 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.644959 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.644791 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.645301 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.645283 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.646385 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.646372 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.646428 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.646395 2527 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:40.647049 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.647033 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:40.647117 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.647061 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:40.647117 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.647073 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:40.663656 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.663639 2527 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-25.ec2.internal\" not found" node="ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.668008 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.667994 2527 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-25.ec2.internal\" not found" node="ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.714628 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.714606 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.714716 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.714631 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.714716 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.714647 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72b231887621a6db8e3ff733ed4d18b5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"72b231887621a6db8e3ff733ed4d18b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.745762 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.745740 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.815491 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815433 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.815491 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815459 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.815634 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815534 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.815634 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815595 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d21f5919af498fd0e2e83cdab6866dfd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"d21f5919af498fd0e2e83cdab6866dfd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.815947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815931 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72b231887621a6db8e3ff733ed4d18b5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"72b231887621a6db8e3ff733ed4d18b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.815984 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.815944 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/72b231887621a6db8e3ff733ed4d18b5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"72b231887621a6db8e3ff733ed4d18b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.846700 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.846677 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.947770 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:40.947741 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:40.966912 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.966890 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:40.971484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:40.971465 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:41.048108 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.048076 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:41.148887 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.148809 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:41.249288 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.249257 2527 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Jun 03 15:03:41.251814 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.251799 2527 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:41.292525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.292507 2527 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:03:41.293064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.292603 2527 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:03:41.293064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.292666 2527 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:03:41.312685 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.312661 2527 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Jun 03 15:03:41.357321 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.357297 2527 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:03:41.360264 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.360248 2527 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Jun 03 15:03:41.378417 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.378400 2527 apiserver.go:52] "Watching apiserver" Jun 03 15:03:41.393433 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.393412 2527 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:03:41.394453 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.394431 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-88d45","openshift-network-operator/iptables-alerter-4hg6d","openshift-ovn-kubernetes/ovnkube-node-wcfq7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5","openshift-image-registry/node-ca-7g4xn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal","openshift-multus/multus-additional-cni-plugins-dnpwj","openshift-multus/network-metrics-daemon-t845l","openshift-network-diagnostics/network-check-target-9svkl","kube-system/konnectivity-agent-f5mjl","openshift-cluster-node-tuning-operator/tuned-jjw7f","openshift-dns/node-resolver-zmc8b"] Jun 03 15:03:41.396701 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.396683 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-88d45" Jun 03 15:03:41.397775 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.397754 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.397955 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.397937 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.398882 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.398866 2527 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:03:41.399398 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.399351 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.400581 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.400560 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.401773 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.401755 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.402982 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.402964 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.403073 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.403027 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:41.404393 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.404376 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:41.404481 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.404419 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:41.405419 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.405402 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.406646 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.406631 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.407899 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.407883 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.408543 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408527 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal"] Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408651 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408667 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m7txf\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408685 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408668 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408709 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408731 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:03:41.408784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.408692 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:03:41.410004 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.409979 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:03:41.410004 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.409978 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g92qj\"" Jun 03 15:03:41.410211 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.410010 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vrj8\"" Jun 03 15:03:41.410211 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.410026 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:03:41.411530 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.411069 2527 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:03:41.413934 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.413918 2527 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:03:41.419974 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.419954 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5f66339-fc2f-4525-bb62-d877f7b8e040-konnectivity-ca\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.420060 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.419979 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-env-overrides\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.420060 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.419994 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.420060 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420014 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cnibin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.420060 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420035 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88hh\" (UniqueName: \"kubernetes.io/projected/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-kube-api-access-r88hh\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420081 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-node-log\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420114 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-registration-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420159 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-etc-selinux\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420184 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-var-lib-kubelet\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420211 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-systemd-units\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420234 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-run\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420249 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:03:41.420276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420259 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpkb\" (UniqueName: \"kubernetes.io/projected/f344d769-0060-4cc7-b21d-553e30f171c8-kube-api-access-6fpkb\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420282 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-etc-kubernetes\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420303 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-hosts-file\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420321 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-cnibin\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420340 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420362 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-k8s-cni-cncf-io\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420365 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420383 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-conf-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420405 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-device-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420429 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-script-lib\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420455 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh68n\" (UniqueName: \"kubernetes.io/projected/c77f3688-788e-4d06-abf4-20afa78d7732-kube-api-access-kh68n\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420479 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-kubernetes\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420501 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-conf\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420524 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdbrg\" (UniqueName: \"kubernetes.io/projected/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-kube-api-access-rdbrg\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420548 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42623f3b-498a-4cd3-9576-34336b3d4be5-host-slash\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420568 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-serviceca\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.420588 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420590 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl7sp\" (UniqueName: \"kubernetes.io/projected/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-kube-api-access-cl7sp\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420632 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-etc-tuned\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420660 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-log-socket\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420682 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4g2\" (UniqueName: \"kubernetes.io/projected/42623f3b-498a-4cd3-9576-34336b3d4be5-kube-api-access-6n4g2\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420748 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-netns\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420777 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420783 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420794 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420777 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420932 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420955 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-config\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420992 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.420992 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-os-release\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421039 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421047 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-socket-dir-parent\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421073 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42623f3b-498a-4cd3-9576-34336b3d4be5-iptables-alerter-script\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421097 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421121 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-sys-fs\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421178 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421205 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.421290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421223 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421227 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-system-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421250 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cni-binary-copy\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421266 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421273 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-multus\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421311 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysconfig\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421335 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421359 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qznkz\" (UniqueName: \"kubernetes.io/projected/f2760330-a219-489c-921b-65a7676e0847-kube-api-access-qznkz\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421386 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5f66339-fc2f-4525-bb62-d877f7b8e040-agent-certs\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421401 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421416 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9h9\" (UniqueName: \"kubernetes.io/projected/62344fe9-784b-4407-9768-aaeb1f1bc849-kube-api-access-jz9h9\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421436 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-daemon-config\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421481 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421519 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-kubelet\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421541 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-slash\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421566 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-var-lib-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421589 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-etc-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421613 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421634 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-netd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421653 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-host\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421686 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421708 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421722 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-hostroot\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421739 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-multus-certs\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421760 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-bin\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421789 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421818 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nk2h\" (UniqueName: \"kubernetes.io/projected/80193d7d-1a8d-46c9-8848-93f381632d27-kube-api-access-8nk2h\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421846 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-host\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421868 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-tmp-dir\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421885 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-systemd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421906 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-socket-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421927 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-sys\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.421966 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-lib-modules\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422002 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-tmp\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.422868 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422023 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-netns\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422049 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-ovn\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422070 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c77f3688-788e-4d06-abf4-20afa78d7732-ovn-node-metrics-cert\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422092 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-modprobe-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422106 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-systemd\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422119 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-bin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422149 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-kubelet\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422177 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-os-release\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422275 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422323 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422413 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422532 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422532 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:03:41.423608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.422624 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.424185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.423987 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-24t6r\"" Jun 03 15:03:41.424185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424004 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gwtcb\"" Jun 03 15:03:41.424185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424038 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cs7cd\"" Jun 03 15:03:41.424185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.423987 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bl5r5\"" Jun 03 15:03:41.424185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424151 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7hbbw\"" Jun 03 15:03:41.424516 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424299 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:03:41.424516 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424349 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:03:41.424516 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424483 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:03:41.424646 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.424541 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c4hsh\"" Jun 03 15:03:41.439470 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.439448 2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 14:58:40 +0000 UTC" deadline="2027-11-18 06:18:13.459795492 +0000 UTC" Jun 03 15:03:41.439470 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.439469 2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12783h14m32.020328651s" Jun 03 15:03:41.446402 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.446380 2527 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:03:41.508301 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.508276 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b231887621a6db8e3ff733ed4d18b5.slice/crio-2da1a2af8f24aad69df8766880a33deb7e2f5d6d40e60d457e842efae37294fb WatchSource:0}: Error finding container 2da1a2af8f24aad69df8766880a33deb7e2f5d6d40e60d457e842efae37294fb: Status 404 returned error can't find the container with id 2da1a2af8f24aad69df8766880a33deb7e2f5d6d40e60d457e842efae37294fb Jun 03 15:03:41.508459 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.508444 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21f5919af498fd0e2e83cdab6866dfd.slice/crio-bff5391338cfa49dcb4bb4cf57529536d9dcf692fb1ca1fb1298bb31c298a865 WatchSource:0}: Error finding container bff5391338cfa49dcb4bb4cf57529536d9dcf692fb1ca1fb1298bb31c298a865: Status 404 returned error can't find the container with id bff5391338cfa49dcb4bb4cf57529536d9dcf692fb1ca1fb1298bb31c298a865 Jun 03 15:03:41.511395 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.511381 2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:03:41.522888 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.522868 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42623f3b-498a-4cd3-9576-34336b3d4be5-iptables-alerter-script\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.522989 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.522895 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.522989 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.522911 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-sys-fs\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.522989 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.522933 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.523113 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523005 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.523113 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523020 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-sys-fs\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.523113 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523107 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523150 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-system-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523167 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cni-binary-copy\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523183 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-multus\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523198 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysconfig\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523218 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.523260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523235 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-system-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523263 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-multus\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523271 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysconfig\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523292 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523312 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qznkz\" (UniqueName: \"kubernetes.io/projected/f2760330-a219-489c-921b-65a7676e0847-kube-api-access-qznkz\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523341 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5f66339-fc2f-4525-bb62-d877f7b8e040-agent-certs\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.523316 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523369 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523424 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.523457 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:42.023401701 +0000 UTC m=+2.156690595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:41.523499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523481 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9h9\" (UniqueName: \"kubernetes.io/projected/62344fe9-784b-4407-9768-aaeb1f1bc849-kube-api-access-jz9h9\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523509 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-daemon-config\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523515 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523519 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42623f3b-498a-4cd3-9576-34336b3d4be5-iptables-alerter-script\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523533 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523578 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-kubelet\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523625 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-kubelet\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523666 2527 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523672 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-slash\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523728 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-slash\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523732 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-var-lib-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523768 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-var-lib-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523804 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-etc-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523830 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523855 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-etc-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523866 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-netd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523903 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-openvswitch\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.523919 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523914 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-netd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523936 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-host\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523957 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.523959 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-daemon-config\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524008 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524014 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-host\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524036 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-hostroot\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524062 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-multus-certs\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524085 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-cni-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524095 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-hostroot\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524088 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-bin\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524145 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-cni-bin\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524152 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-multus-certs\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524165 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524192 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nk2h\" (UniqueName: \"kubernetes.io/projected/80193d7d-1a8d-46c9-8848-93f381632d27-kube-api-access-8nk2h\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524217 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-host\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524240 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-tmp-dir\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524263 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-systemd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.524651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524286 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-socket-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524308 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-sys\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524319 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524333 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-systemd\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524332 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-lib-modules\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524361 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-tmp\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524391 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524399 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-netns\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524418 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cni-binary-copy\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524437 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-lib-modules\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524452 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-ovn\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524469 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-netns\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524423 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-run-ovn\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524488 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-sys\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524510 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c77f3688-788e-4d06-abf4-20afa78d7732-ovn-node-metrics-cert\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524537 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-modprobe-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524561 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-systemd\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524511 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-host\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.525568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524568 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-tmp-dir\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524586 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-bin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524610 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-socket-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524614 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-kubelet\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524639 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-os-release\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524658 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-kubelet\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524664 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5f66339-fc2f-4525-bb62-d877f7b8e040-konnectivity-ca\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524665 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-systemd\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524673 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-modprobe-d\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524691 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-var-lib-cni-bin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524731 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-os-release\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524757 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-env-overrides\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524781 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524803 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cnibin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524857 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r88hh\" (UniqueName: \"kubernetes.io/projected/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-kube-api-access-r88hh\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524868 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524903 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-node-log\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.526392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524928 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-cnibin\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524954 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-registration-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524977 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-etc-selinux\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.524999 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-var-lib-kubelet\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525028 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-systemd-units\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525050 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-run\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525073 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpkb\" (UniqueName: \"kubernetes.io/projected/f344d769-0060-4cc7-b21d-553e30f171c8-kube-api-access-6fpkb\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525099 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-etc-kubernetes\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525124 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-hosts-file\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525169 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-var-lib-kubelet\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525184 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-cnibin\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525192 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5f66339-fc2f-4525-bb62-d877f7b8e040-konnectivity-ca\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525209 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525213 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-node-log\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525235 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-k8s-cni-cncf-io\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525250 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-env-overrides\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525270 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-registration-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525257 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-conf-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525295 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-etc-selinux\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525320 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-run\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525322 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-conf-dir\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525331 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80193d7d-1a8d-46c9-8848-93f381632d27-cnibin\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525339 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-hosts-file\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525342 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-device-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525364 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-systemd-units\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525384 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-script-lib\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525410 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh68n\" (UniqueName: \"kubernetes.io/projected/c77f3688-788e-4d06-abf4-20afa78d7732-kube-api-access-kh68n\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525414 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-etc-kubernetes\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525419 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62344fe9-784b-4407-9768-aaeb1f1bc849-device-dir\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525386 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-host-run-k8s-cni-cncf-io\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525432 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-kubernetes\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525480 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-conf\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525512 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdbrg\" (UniqueName: \"kubernetes.io/projected/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-kube-api-access-rdbrg\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525538 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42623f3b-498a-4cd3-9576-34336b3d4be5-host-slash\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525538 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-kubernetes\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.527732 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525641 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f344d769-0060-4cc7-b21d-553e30f171c8-etc-sysctl-conf\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525674 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-serviceca\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525701 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl7sp\" (UniqueName: \"kubernetes.io/projected/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-kube-api-access-cl7sp\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525727 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-etc-tuned\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525750 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-log-socket\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525775 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4g2\" (UniqueName: \"kubernetes.io/projected/42623f3b-498a-4cd3-9576-34336b3d4be5-kube-api-access-6n4g2\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525779 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42623f3b-498a-4cd3-9576-34336b3d4be5-host-slash\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525831 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-netns\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525875 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525901 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-config\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525920 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-script-lib\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525925 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-os-release\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525976 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-os-release\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525974 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-socket-dir-parent\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.525998 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80193d7d-1a8d-46c9-8848-93f381632d27-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526061 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-log-socket\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526064 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-multus-socket-dir-parent\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526283 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-ovn-kubernetes\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528218 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526334 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c77f3688-788e-4d06-abf4-20afa78d7732-host-run-netns\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526370 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-serviceca\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.526814 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c77f3688-788e-4d06-abf4-20afa78d7732-ovnkube-config\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.527221 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-tmp\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.527329 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c77f3688-788e-4d06-abf4-20afa78d7732-ovn-node-metrics-cert\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.527369 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5f66339-fc2f-4525-bb62-d877f7b8e040-agent-certs\") pod \"konnectivity-agent-f5mjl\" (UID: \"b5f66339-fc2f-4525-bb62-d877f7b8e040\") " pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.528671 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.527990 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f344d769-0060-4cc7-b21d-553e30f171c8-etc-tuned\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.533610 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.533592 2527 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vrlp" Jun 03 15:03:41.538567 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.538549 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88hh\" (UniqueName: \"kubernetes.io/projected/94a8d359-a6f4-4056-b3b3-d0cbc14ea666-kube-api-access-r88hh\") pod \"node-resolver-zmc8b\" (UID: \"94a8d359-a6f4-4056-b3b3-d0cbc14ea666\") " pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.544011 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.543953 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" event={"ID":"72b231887621a6db8e3ff733ed4d18b5","Type":"ContainerStarted","Data":"2da1a2af8f24aad69df8766880a33deb7e2f5d6d40e60d457e842efae37294fb"} Jun 03 15:03:41.544881 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.544861 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"d21f5919af498fd0e2e83cdab6866dfd","Type":"ContainerStarted","Data":"bff5391338cfa49dcb4bb4cf57529536d9dcf692fb1ca1fb1298bb31c298a865"} Jun 03 15:03:41.551964 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.551949 2527 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vrlp" Jun 03 15:03:41.553774 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.553758 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4g2\" (UniqueName: \"kubernetes.io/projected/42623f3b-498a-4cd3-9576-34336b3d4be5-kube-api-access-6n4g2\") pod \"iptables-alerter-4hg6d\" (UID: \"42623f3b-498a-4cd3-9576-34336b3d4be5\") " pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.555874 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.555859 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh68n\" (UniqueName: \"kubernetes.io/projected/c77f3688-788e-4d06-abf4-20afa78d7732-kube-api-access-kh68n\") pod \"ovnkube-node-wcfq7\" (UID: \"c77f3688-788e-4d06-abf4-20afa78d7732\") " pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.557666 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.557652 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:41.557715 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.557672 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:41.557715 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.557684 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:41.557802 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:41.557740 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:42.057724076 +0000 UTC m=+2.191012972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:41.559523 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.559503 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl7sp\" (UniqueName: \"kubernetes.io/projected/f17d30e5-ea52-4050-9f29-9a7fcdd036c7-kube-api-access-cl7sp\") pod \"node-ca-7g4xn\" (UID: \"f17d30e5-ea52-4050-9f29-9a7fcdd036c7\") " pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.559694 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.559673 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nk2h\" (UniqueName: \"kubernetes.io/projected/80193d7d-1a8d-46c9-8848-93f381632d27-kube-api-access-8nk2h\") pod \"multus-additional-cni-plugins-dnpwj\" (UID: \"80193d7d-1a8d-46c9-8848-93f381632d27\") " pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.559773 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.559760 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9h9\" (UniqueName: \"kubernetes.io/projected/62344fe9-784b-4407-9768-aaeb1f1bc849-kube-api-access-jz9h9\") pod \"aws-ebs-csi-driver-node-n4vg5\" (UID: \"62344fe9-784b-4407-9768-aaeb1f1bc849\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.571232 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.571210 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpkb\" (UniqueName: \"kubernetes.io/projected/f344d769-0060-4cc7-b21d-553e30f171c8-kube-api-access-6fpkb\") pod \"tuned-jjw7f\" (UID: \"f344d769-0060-4cc7-b21d-553e30f171c8\") " pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.571400 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.571382 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdbrg\" (UniqueName: \"kubernetes.io/projected/252e10c8-b1ee-4a03-85e6-fa495ec5bce3-kube-api-access-rdbrg\") pod \"multus-88d45\" (UID: \"252e10c8-b1ee-4a03-85e6-fa495ec5bce3\") " pod="openshift-multus/multus-88d45" Jun 03 15:03:41.593223 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.593206 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qznkz\" (UniqueName: \"kubernetes.io/projected/f2760330-a219-489c-921b-65a7676e0847-kube-api-access-qznkz\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:41.720254 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.720231 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-88d45" Jun 03 15:03:41.726181 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.726157 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252e10c8_b1ee_4a03_85e6_fa495ec5bce3.slice/crio-ed66497548bc73f38b653ac0c448f18390096797793f805edc063c9d4e9f1375 WatchSource:0}: Error finding container ed66497548bc73f38b653ac0c448f18390096797793f805edc063c9d4e9f1375: Status 404 returned error can't find the container with id ed66497548bc73f38b653ac0c448f18390096797793f805edc063c9d4e9f1375 Jun 03 15:03:41.731184 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.731166 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4hg6d" Jun 03 15:03:41.737254 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.737233 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42623f3b_498a_4cd3_9576_34336b3d4be5.slice/crio-25a7bcbfe3a29f2fd072daa21b169755801bfc37ceacad5e10c9281bb15341d9 WatchSource:0}: Error finding container 25a7bcbfe3a29f2fd072daa21b169755801bfc37ceacad5e10c9281bb15341d9: Status 404 returned error can't find the container with id 25a7bcbfe3a29f2fd072daa21b169755801bfc37ceacad5e10c9281bb15341d9 Jun 03 15:03:41.746194 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.746177 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:03:41.752456 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.752434 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77f3688_788e_4d06_abf4_20afa78d7732.slice/crio-051c98c7a2d9f44cd3b8adff406e832e1c783bd08d497d34bc7c50b76dec90ee WatchSource:0}: Error finding container 051c98c7a2d9f44cd3b8adff406e832e1c783bd08d497d34bc7c50b76dec90ee: Status 404 returned error can't find the container with id 051c98c7a2d9f44cd3b8adff406e832e1c783bd08d497d34bc7c50b76dec90ee Jun 03 15:03:41.757890 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.757874 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" Jun 03 15:03:41.763333 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.763314 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62344fe9_784b_4407_9768_aaeb1f1bc849.slice/crio-27fe024d068eca4f1f9cb76b53d44966a010b0e48adb115f45cb75ba491a9888 WatchSource:0}: Error finding container 27fe024d068eca4f1f9cb76b53d44966a010b0e48adb115f45cb75ba491a9888: Status 404 returned error can't find the container with id 27fe024d068eca4f1f9cb76b53d44966a010b0e48adb115f45cb75ba491a9888 Jun 03 15:03:41.763333 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.763324 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7g4xn" Jun 03 15:03:41.769106 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.769085 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17d30e5_ea52_4050_9f29_9a7fcdd036c7.slice/crio-5db7f118d331d1a86dccf7bd9c326799bf6f49fe717e8e7da9a5fe43e5de0c6e WatchSource:0}: Error finding container 5db7f118d331d1a86dccf7bd9c326799bf6f49fe717e8e7da9a5fe43e5de0c6e: Status 404 returned error can't find the container with id 5db7f118d331d1a86dccf7bd9c326799bf6f49fe717e8e7da9a5fe43e5de0c6e Jun 03 15:03:41.779572 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.779553 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" Jun 03 15:03:41.784472 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.784451 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80193d7d_1a8d_46c9_8848_93f381632d27.slice/crio-2cc988453f84f9d7953e99c3e64477835703973b8f8a1c6a665100c2c7995e0c WatchSource:0}: Error finding container 2cc988453f84f9d7953e99c3e64477835703973b8f8a1c6a665100c2c7995e0c: Status 404 returned error can't find the container with id 2cc988453f84f9d7953e99c3e64477835703973b8f8a1c6a665100c2c7995e0c Jun 03 15:03:41.793052 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.793037 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:03:41.798525 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.798504 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f66339_fc2f_4525_bb62_d877f7b8e040.slice/crio-1ea1289889d8bda7bc44b750a1f3018344204d2440dbd914c5906eb4d1107c19 WatchSource:0}: Error finding container 1ea1289889d8bda7bc44b750a1f3018344204d2440dbd914c5906eb4d1107c19: Status 404 returned error can't find the container with id 1ea1289889d8bda7bc44b750a1f3018344204d2440dbd914c5906eb4d1107c19 Jun 03 15:03:41.815041 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.815025 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" Jun 03 15:03:41.818993 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.818973 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmc8b" Jun 03 15:03:41.820792 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.820771 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf344d769_0060_4cc7_b21d_553e30f171c8.slice/crio-499a5367ec8dae49893deac107aa6eb1d64b550b1658bc033f09d5968c926701 WatchSource:0}: Error finding container 499a5367ec8dae49893deac107aa6eb1d64b550b1658bc033f09d5968c926701: Status 404 returned error can't find the container with id 499a5367ec8dae49893deac107aa6eb1d64b550b1658bc033f09d5968c926701 Jun 03 15:03:41.825193 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:03:41.825154 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a8d359_a6f4_4056_b3b3_d0cbc14ea666.slice/crio-fe1e924b5edcb3c849b109977b7b3daf52c54a30d979cefae8ccb58a361a68a2 WatchSource:0}: Error finding container fe1e924b5edcb3c849b109977b7b3daf52c54a30d979cefae8ccb58a361a68a2: Status 404 returned error can't find the container with id fe1e924b5edcb3c849b109977b7b3daf52c54a30d979cefae8ccb58a361a68a2 Jun 03 15:03:41.838774 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:41.838753 2527 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:42.012357 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.012266 2527 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:42.028913 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.028884 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:42.029071 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.029035 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:42.029153 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.029103 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.029081497 +0000 UTC m=+3.162370393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:42.129244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.129209 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:42.129421 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.129374 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:42.129421 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.129393 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:42.129421 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.129406 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:42.129579 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.129462 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.129444855 +0000 UTC m=+3.262733741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:42.214464 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.214247 2527 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:42.541550 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.541520 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:42.542316 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:42.541644 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:42.553013 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.552977 2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:58:41 +0000 UTC" deadline="2027-10-29 14:24:07.878765203 +0000 UTC" Jun 03 15:03:42.553013 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.553012 2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12311h20m25.325756903s" Jun 03 15:03:42.573338 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.573304 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerStarted","Data":"2cc988453f84f9d7953e99c3e64477835703973b8f8a1c6a665100c2c7995e0c"} Jun 03 15:03:42.579673 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.579602 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7g4xn" event={"ID":"f17d30e5-ea52-4050-9f29-9a7fcdd036c7","Type":"ContainerStarted","Data":"5db7f118d331d1a86dccf7bd9c326799bf6f49fe717e8e7da9a5fe43e5de0c6e"} Jun 03 15:03:42.601310 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.601277 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmc8b" event={"ID":"94a8d359-a6f4-4056-b3b3-d0cbc14ea666","Type":"ContainerStarted","Data":"fe1e924b5edcb3c849b109977b7b3daf52c54a30d979cefae8ccb58a361a68a2"} Jun 03 15:03:42.614467 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.614433 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" event={"ID":"f344d769-0060-4cc7-b21d-553e30f171c8","Type":"ContainerStarted","Data":"499a5367ec8dae49893deac107aa6eb1d64b550b1658bc033f09d5968c926701"} Jun 03 15:03:42.628294 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.628236 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" event={"ID":"62344fe9-784b-4407-9768-aaeb1f1bc849","Type":"ContainerStarted","Data":"27fe024d068eca4f1f9cb76b53d44966a010b0e48adb115f45cb75ba491a9888"} Jun 03 15:03:42.630497 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.630474 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"051c98c7a2d9f44cd3b8adff406e832e1c783bd08d497d34bc7c50b76dec90ee"} Jun 03 15:03:42.656557 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.656489 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4hg6d" event={"ID":"42623f3b-498a-4cd3-9576-34336b3d4be5","Type":"ContainerStarted","Data":"25a7bcbfe3a29f2fd072daa21b169755801bfc37ceacad5e10c9281bb15341d9"} Jun 03 15:03:42.664462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.664386 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-88d45" event={"ID":"252e10c8-b1ee-4a03-85e6-fa495ec5bce3","Type":"ContainerStarted","Data":"ed66497548bc73f38b653ac0c448f18390096797793f805edc063c9d4e9f1375"} Jun 03 15:03:42.672522 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:42.672499 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f5mjl" event={"ID":"b5f66339-fc2f-4525-bb62-d877f7b8e040","Type":"ContainerStarted","Data":"1ea1289889d8bda7bc44b750a1f3018344204d2440dbd914c5906eb4d1107c19"} Jun 03 15:03:43.036792 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.036759 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:43.036958 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.036937 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:43.037031 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.037001 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:45.036982685 +0000 UTC m=+5.170271566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:43.083321 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.083249 2527 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:43.137108 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.137080 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:43.137286 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.137250 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:43.137286 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.137270 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:43.137405 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.137290 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:43.137405 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.137343 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:45.137326482 +0000 UTC m=+5.270615370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:43.541650 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.541618 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:43.542092 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:43.541735 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:43.553383 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.553350 2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:58:41 +0000 UTC" deadline="2028-03-13 01:39:17.426136916 +0000 UTC" Jun 03 15:03:43.553383 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:43.553383 2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15562h35m33.872757151s" Jun 03 15:03:44.543738 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:44.543566 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:44.546548 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:44.545731 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:45.056998 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:45.056922 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:45.057223 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.057066 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:45.057223 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.057148 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:49.057116146 +0000 UTC m=+9.190405029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:45.157798 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:45.157753 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:45.157981 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.157933 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:45.157981 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.157953 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:45.157981 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.157966 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:45.158199 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.158028 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:49.158011163 +0000 UTC m=+9.291300046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:45.541519 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:45.541482 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:45.541683 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:45.541623 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:46.542792 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:46.542760 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:46.543310 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:46.542894 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:47.541658 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:47.541616 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:47.541850 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:47.541757 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:48.543381 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:48.543342 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:48.543864 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:48.543501 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:49.089911 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:49.089878 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:49.090212 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.090029 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:49.090212 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.090087 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:57.090067787 +0000 UTC m=+17.223356684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:49.190685 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:49.190572 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:49.190864 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.190727 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:49.190864 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.190745 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:49.190864 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.190758 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:49.190864 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.190809 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:57.190792212 +0000 UTC m=+17.324081094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:49.541293 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:49.541258 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:49.541507 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:49.541384 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:50.541909 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:50.541870 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:50.542418 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:50.542004 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:51.541478 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:51.541423 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:51.541653 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:51.541556 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:52.541147 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:52.541051 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:52.541601 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:52.541196 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:53.541281 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:53.541250 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:53.541747 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:53.541355 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:54.541604 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:54.541569 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:54.541991 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:54.541693 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:55.541638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:55.541599 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:55.541985 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:55.541705 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:56.541915 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:56.541883 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:56.542492 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:56.542015 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:57.156927 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:57.156897 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:57.157152 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.157050 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:57.157152 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.157119 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:13.157097971 +0000 UTC m=+33.290386850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:57.257500 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:57.257462 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:57.257677 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.257629 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:57.257677 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.257656 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:57.257677 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.257671 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:57.257780 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.257728 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:13.257714368 +0000 UTC m=+33.391003247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:57.541541 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:57.541502 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:57.541721 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:57.541679 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:03:58.542076 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:58.542042 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:03:58.542534 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:58.542200 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:03:59.541794 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:03:59.541759 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:03:59.542007 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:03:59.541868 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:00.542055 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.542029 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:00.542387 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:00.542121 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:00.716990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.716963 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" event={"ID":"72b231887621a6db8e3ff733ed4d18b5","Type":"ContainerStarted","Data":"ed063b6b50b5878e9bcd8fde3aa13a93e153b8bf388b1f13ffcddddf81cc1281"} Jun 03 15:04:00.718160 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.718125 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" event={"ID":"f344d769-0060-4cc7-b21d-553e30f171c8","Type":"ContainerStarted","Data":"28230d8deeba75f74a697da2babefda2b8bc4252e3f519dec2cbb91cf4c126be"} Jun 03 15:04:00.719385 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.719366 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-88d45" event={"ID":"252e10c8-b1ee-4a03-85e6-fa495ec5bce3","Type":"ContainerStarted","Data":"c0c53606c13028d60272535f982480565eb4bd378d7584a1ad0252a74d29c379"} Jun 03 15:04:00.810393 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.810275 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" podStartSLOduration=19.810254541 podStartE2EDuration="19.810254541s" podCreationTimestamp="2026-06-03 15:03:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:00.755955327 +0000 UTC m=+20.889244227" watchObservedRunningTime="2026-06-03 15:04:00.810254541 +0000 UTC m=+20.943543443" Jun 03 15:04:00.868741 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:00.868599 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-88d45" podStartSLOduration=2.258238223 podStartE2EDuration="20.868578069s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.727774387 +0000 UTC m=+1.861063265" lastFinishedPulling="2026-06-03 15:04:00.338114217 +0000 UTC m=+20.471403111" observedRunningTime="2026-06-03 15:04:00.810068343 +0000 UTC m=+20.943357266" watchObservedRunningTime="2026-06-03 15:04:00.868578069 +0000 UTC m=+21.001866971" Jun 03 15:04:01.541558 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.541259 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:01.541693 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:01.541632 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:01.722210 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.722175 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f5mjl" event={"ID":"b5f66339-fc2f-4525-bb62-d877f7b8e040","Type":"ContainerStarted","Data":"be49b08d6685376ab3bb754fc45284b59752e11bd8c07c8176c538adb9048b79"} Jun 03 15:04:01.723583 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.723560 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="5a764f5d21eaf831c1768ba61ee2c6d35a9ebf599efd799e340039c862833c7e" exitCode=0 Jun 03 15:04:01.723687 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.723624 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"5a764f5d21eaf831c1768ba61ee2c6d35a9ebf599efd799e340039c862833c7e"} Jun 03 15:04:01.724873 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.724848 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7g4xn" event={"ID":"f17d30e5-ea52-4050-9f29-9a7fcdd036c7","Type":"ContainerStarted","Data":"e2d506b0a46cfcfc4f04112723e022196adc022b494981bd19b3820cd9495c11"} Jun 03 15:04:01.726281 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.726213 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmc8b" event={"ID":"94a8d359-a6f4-4056-b3b3-d0cbc14ea666","Type":"ContainerStarted","Data":"7c051865a0703763bf634c70da4eeca906df2e44e4c0ec7d2a68d5d0b57e0cbb"} Jun 03 15:04:01.727488 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.727465 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" event={"ID":"62344fe9-784b-4407-9768-aaeb1f1bc849","Type":"ContainerStarted","Data":"0fd5207b154cd745ce5cfc4484ef58f510efa0ddf93525303c83602b4a1c94a0"} Jun 03 15:04:01.730146 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730114 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"276aa070b90bbc4cac37a08c18533fed2e05cd8baee411cd79a427def64c537c"} Jun 03 15:04:01.730245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730154 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"4572cacdb130e4f256a30af9d2de6425c1820d5a35fc58f1919dadb9301d4b5b"} Jun 03 15:04:01.730245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730165 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"089c76583bd25afaec3fa9818f2505e6118f4ec098462348c8fd5aff13d06ef8"} Jun 03 15:04:01.730245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730174 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"f119c6136df46b9e44f3bfc99add82bae62c84555c2ae4d18a629e12d1652f51"} Jun 03 15:04:01.730245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730183 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"7d4fe46874cda3a0e261c4bda29d99f061954f537686a74aec76c2f4ac0f2612"} Jun 03 15:04:01.730245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.730191 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"939000dbdca0e36846445fc5a19cfe6c3a34e0c0ab419d6175d741a0857ed84c"} Jun 03 15:04:01.731434 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.731415 2527 generic.go:358] "Generic (PLEG): container finished" podID="d21f5919af498fd0e2e83cdab6866dfd" containerID="82149770aa2bab10cf9e20999a6d3c6e36f2db14f1b20fb94d6b61a7f41e3dc7" exitCode=0 Jun 03 15:04:01.731540 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.731475 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"d21f5919af498fd0e2e83cdab6866dfd","Type":"ContainerDied","Data":"82149770aa2bab10cf9e20999a6d3c6e36f2db14f1b20fb94d6b61a7f41e3dc7"} Jun 03 15:04:01.782642 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.782587 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jjw7f" podStartSLOduration=3.308514543 podStartE2EDuration="21.782570668s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.822128186 +0000 UTC m=+1.955417064" lastFinishedPulling="2026-06-03 15:04:00.296184305 +0000 UTC m=+20.429473189" observedRunningTime="2026-06-03 15:04:00.877710394 +0000 UTC m=+21.010999318" watchObservedRunningTime="2026-06-03 15:04:01.782570668 +0000 UTC m=+21.915859571" Jun 03 15:04:01.837796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.837736 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f5mjl" podStartSLOduration=3.343414279 podStartE2EDuration="21.837717741s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.799965712 +0000 UTC m=+1.933254590" lastFinishedPulling="2026-06-03 15:04:00.29426916 +0000 UTC m=+20.427558052" observedRunningTime="2026-06-03 15:04:01.784810027 +0000 UTC m=+21.918098929" watchObservedRunningTime="2026-06-03 15:04:01.837717741 +0000 UTC m=+21.971006645" Jun 03 15:04:01.838457 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.838417 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7g4xn" podStartSLOduration=3.341956527 podStartE2EDuration="21.838410569s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.770625095 +0000 UTC m=+1.903913973" lastFinishedPulling="2026-06-03 15:04:00.267079113 +0000 UTC m=+20.400368015" observedRunningTime="2026-06-03 15:04:01.837319387 +0000 UTC m=+21.970608302" watchObservedRunningTime="2026-06-03 15:04:01.838410569 +0000 UTC m=+21.971699471" Jun 03 15:04:01.969817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:01.969777 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zmc8b" podStartSLOduration=3.529051909 podStartE2EDuration="21.969764688s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.826327768 +0000 UTC m=+1.959616646" lastFinishedPulling="2026-06-03 15:04:00.267040531 +0000 UTC m=+20.400329425" observedRunningTime="2026-06-03 15:04:01.969697104 +0000 UTC m=+22.102986006" watchObservedRunningTime="2026-06-03 15:04:01.969764688 +0000 UTC m=+22.103053589" Jun 03 15:04:02.182030 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.182009 2527 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:04:02.331766 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.331686 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:04:02.332244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.332224 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:04:02.483970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.483881 2527 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:04:02.18202649Z","UUID":"554ff460-8ef0-4171-ba2b-06ca66a492bb","Handler":null,"Name":"","Endpoint":""} Jun 03 15:04:02.485679 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.485657 2527 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:04:02.485803 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.485687 2527 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:04:02.541419 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.541395 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:02.541568 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:02.541512 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:02.735689 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.735639 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" event={"ID":"62344fe9-784b-4407-9768-aaeb1f1bc849","Type":"ContainerStarted","Data":"f422d545da60cf5115d504ca57e4c7048fcb2c16b0a435464a7bcf82c0cfd12d"} Jun 03 15:04:02.737370 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.737343 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4hg6d" event={"ID":"42623f3b-498a-4cd3-9576-34336b3d4be5","Type":"ContainerStarted","Data":"e6321d43506c79d35112d7e5d38980491157eadaa378f4f9ee47ed0bd5e9b0db"} Jun 03 15:04:02.740182 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.740157 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"d21f5919af498fd0e2e83cdab6866dfd","Type":"ContainerStarted","Data":"d3b855e1b15bff05cd19436d35a8098573dbe461de4983f78442aab6ad3f07b5"} Jun 03 15:04:02.740893 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.740872 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:04:02.741718 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.741680 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f5mjl" Jun 03 15:04:02.799605 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.799556 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4hg6d" podStartSLOduration=4.23727939 podStartE2EDuration="22.799537916s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.738670783 +0000 UTC m=+1.871959661" lastFinishedPulling="2026-06-03 15:04:00.300929305 +0000 UTC m=+20.434218187" observedRunningTime="2026-06-03 15:04:02.798430427 +0000 UTC m=+22.931719328" watchObservedRunningTime="2026-06-03 15:04:02.799537916 +0000 UTC m=+22.932826820" Jun 03 15:04:02.860719 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:02.860665 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" podStartSLOduration=21.860646971 podStartE2EDuration="21.860646971s" podCreationTimestamp="2026-06-03 15:03:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:02.829622516 +0000 UTC m=+22.962911418" watchObservedRunningTime="2026-06-03 15:04:02.860646971 +0000 UTC m=+22.993935873" Jun 03 15:04:03.541577 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:03.541552 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:03.541696 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:03.541676 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:03.744274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:03.744226 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" event={"ID":"62344fe9-784b-4407-9768-aaeb1f1bc849","Type":"ContainerStarted","Data":"1ca4294e3130592fe7d83af0305a708188b671d7d2da40dc19f8aad962ebba2e"} Jun 03 15:04:03.747404 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:03.747341 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"a03444095287ace0d48e7cba6a4b28fa86e8cb72db29ce4c76d0d30faee9d447"} Jun 03 15:04:03.789101 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:03.789031 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n4vg5" podStartSLOduration=2.172605408 podStartE2EDuration="23.789011151s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.764831207 +0000 UTC m=+1.898120090" lastFinishedPulling="2026-06-03 15:04:03.38123695 +0000 UTC m=+23.514525833" observedRunningTime="2026-06-03 15:04:03.788327613 +0000 UTC m=+23.921616501" watchObservedRunningTime="2026-06-03 15:04:03.789011151 +0000 UTC m=+23.922300053" Jun 03 15:04:04.541927 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:04.541895 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:04.542098 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:04.542006 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:05.541838 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:05.541598 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:05.542249 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:05.541937 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:06.541457 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.541425 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:06.541614 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:06.541536 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:06.754619 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.754589 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="2e27aa1ae9ffa33bc16c3e7c1fe5de6f412860e4d1490c61d1c4c5242bf70a0f" exitCode=0 Jun 03 15:04:06.755497 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.754677 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"2e27aa1ae9ffa33bc16c3e7c1fe5de6f412860e4d1490c61d1c4c5242bf70a0f"} Jun 03 15:04:06.758032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.757913 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" event={"ID":"c77f3688-788e-4d06-abf4-20afa78d7732","Type":"ContainerStarted","Data":"e760d69622d9971a0ead9e14df29ce34ff9e896194871d164686205350555aef"} Jun 03 15:04:06.758174 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.758157 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:06.758229 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.758184 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:06.773338 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.773315 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:06.860297 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:06.860231 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" podStartSLOduration=7.770193821 podStartE2EDuration="26.860206634s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.753844595 +0000 UTC m=+1.887133473" lastFinishedPulling="2026-06-03 15:04:00.843857398 +0000 UTC m=+20.977146286" observedRunningTime="2026-06-03 15:04:06.858789652 +0000 UTC m=+26.992078561" watchObservedRunningTime="2026-06-03 15:04:06.860206634 +0000 UTC m=+26.993495536" Jun 03 15:04:07.541924 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:07.541689 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:07.542084 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:07.542020 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:07.761929 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:07.761890 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="47edf3069e056219877254e678d6f18688bb83f8e5f39f704e396b8fa8b3f337" exitCode=0 Jun 03 15:04:07.762309 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:07.761978 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"47edf3069e056219877254e678d6f18688bb83f8e5f39f704e396b8fa8b3f337"} Jun 03 15:04:07.763223 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:07.762617 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:07.777257 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:07.777167 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:08.541749 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:08.541715 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:08.541919 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:08.541822 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:08.766025 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:08.765987 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="959a54cb46be101aceba38b1f9aef08432b42044f5273cdc0ceaff8556dce30a" exitCode=0 Jun 03 15:04:08.766500 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:08.766055 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"959a54cb46be101aceba38b1f9aef08432b42044f5273cdc0ceaff8556dce30a"} Jun 03 15:04:09.542060 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:09.542024 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:09.542247 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:09.542171 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:10.542221 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:10.542190 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:10.542771 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:10.542326 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:11.541025 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:11.540990 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:11.541219 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:11.541100 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:12.542014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:12.541978 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:12.542486 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:12.542117 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:13.179713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:13.179670 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:13.179934 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.179822 2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:04:13.179934 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.179893 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs podName:f2760330-a219-489c-921b-65a7676e0847 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:45.179872059 +0000 UTC m=+65.313160946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs") pod "network-metrics-daemon-t845l" (UID: "f2760330-a219-489c-921b-65a7676e0847") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:04:13.280962 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:13.280911 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:13.281154 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.281075 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:04:13.281154 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.281100 2527 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:04:13.281154 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.281113 2527 projected.go:194] Error preparing data for projected volume kube-api-access-5ntk7 for pod openshift-network-diagnostics/network-check-target-9svkl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:04:13.281312 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.281192 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7 podName:7469f4f6-b163-41c1-991c-30faca027d10 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:45.281171298 +0000 UTC m=+65.414460182 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ntk7" (UniqueName: "kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7") pod "network-check-target-9svkl" (UID: "7469f4f6-b163-41c1-991c-30faca027d10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:04:13.541350 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:13.541315 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:13.541518 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:13.541428 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:14.541654 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:14.541623 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:14.542015 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:14.541770 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:14.552506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:14.552475 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9svkl"] Jun 03 15:04:14.552642 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:14.552571 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:14.552695 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:14.552658 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:14.571704 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:14.571639 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t845l"] Jun 03 15:04:14.776230 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:14.776198 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:14.776360 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:14.776300 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:15.780544 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:15.780510 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="e712ea9c1503785fb58e76443414945eb5abf272f2759010ebf67cbfff02553b" exitCode=0 Jun 03 15:04:15.780890 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:15.780557 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"e712ea9c1503785fb58e76443414945eb5abf272f2759010ebf67cbfff02553b"} Jun 03 15:04:16.541315 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:16.541096 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:16.541468 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:16.541157 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:16.541468 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:16.541359 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:16.541468 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:16.541428 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:16.784609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:16.784574 2527 generic.go:358] "Generic (PLEG): container finished" podID="80193d7d-1a8d-46c9-8848-93f381632d27" containerID="c7be5dac5ba7c9e04e4e31b4dbcbf1fb98e7906f6584ad62ccb9cf2f38893564" exitCode=0 Jun 03 15:04:16.784995 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:16.784627 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerDied","Data":"c7be5dac5ba7c9e04e4e31b4dbcbf1fb98e7906f6584ad62ccb9cf2f38893564"} Jun 03 15:04:17.789153 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:17.789100 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" event={"ID":"80193d7d-1a8d-46c9-8848-93f381632d27","Type":"ContainerStarted","Data":"f987746e422c7196ceb056fc51914652699b24294425574cf3e8fe4dec9a993c"} Jun 03 15:04:18.541240 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.541198 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:18.541408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.541198 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:18.541408 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:18.541328 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9svkl" podUID="7469f4f6-b163-41c1-991c-30faca027d10" Jun 03 15:04:18.541546 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:18.541412 2527 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t845l" podUID="f2760330-a219-489c-921b-65a7676e0847" Jun 03 15:04:18.670493 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.670462 2527 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeReady" Jun 03 15:04:18.670647 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.670579 2527 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:04:18.770754 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.770696 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dnpwj" podStartSLOduration=5.798675494 podStartE2EDuration="38.770673154s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:03:41.785873485 +0000 UTC m=+1.919162363" lastFinishedPulling="2026-06-03 15:04:14.757871141 +0000 UTC m=+34.891160023" observedRunningTime="2026-06-03 15:04:17.855587553 +0000 UTC m=+37.988876454" watchObservedRunningTime="2026-06-03 15:04:18.770673154 +0000 UTC m=+38.903962056" Jun 03 15:04:18.770972 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.770956 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b47f5b74b-gwcdz"] Jun 03 15:04:18.793197 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.793112 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.795829 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.795802 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dr6lc"] Jun 03 15:04:18.808043 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.808014 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-24k7v\"" Jun 03 15:04:18.808210 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.808184 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:04:18.809444 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.809427 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:04:18.811055 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.811037 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:04:18.816565 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.816548 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:04:18.817483 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.817466 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b47f5b74b-gwcdz"] Jun 03 15:04:18.817608 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.817597 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.826408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.826059 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:04:18.826408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.826175 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:04:18.826408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.826202 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:04:18.826408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.826249 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:04:18.826408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.826318 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d8b8x\"" Jun 03 15:04:18.829900 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.829876 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ncp2g"] Jun 03 15:04:18.855178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.855112 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dr6lc"] Jun 03 15:04:18.855353 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.855276 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:18.861981 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.861960 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:04:18.861981 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.861972 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:04:18.862176 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.862035 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p69ds\"" Jun 03 15:04:18.862262 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.862250 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:04:18.867648 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.867623 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncp2g"] Jun 03 15:04:18.907973 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.907940 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hnwr2"] Jun 03 15:04:18.923574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.923543 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:18.926996 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.926972 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-installation-pull-secrets\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927118 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927096 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-trusted-ca\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927229 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927158 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8t4\" (UniqueName: \"kubernetes.io/projected/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-api-access-cm8t4\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.927229 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927196 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64d29bc4-41e5-4d33-a634-7f4172ea76ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.927336 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927276 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5rxw\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-kube-api-access-n5rxw\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927336 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927327 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-image-registry-private-configuration\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927343 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-ca-trust-extracted\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927358 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-certificates\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927383 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64d29bc4-41e5-4d33-a634-7f4172ea76ea-crio-socket\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.927574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927478 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64d29bc4-41e5-4d33-a634-7f4172ea76ea-data-volume\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.927574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927507 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:18.927574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927530 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-tls\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.927574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.927550 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-bound-sa-token\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:18.931713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.931689 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:04:18.931713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.931714 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:04:18.932320 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.932301 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m5pnr\"" Jun 03 15:04:18.943040 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:18.943007 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hnwr2"] Jun 03 15:04:19.028787 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028748 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-tls\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.028787 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028788 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-bound-sa-token\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028810 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-tmp-dir\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028832 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-config-volume\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028856 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkft9\" (UniqueName: \"kubernetes.io/projected/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-kube-api-access-hkft9\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028904 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d363a17-8ed8-4831-8c0e-83cf2473018e-cert\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028957 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-installation-pull-secrets\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.028993 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-trusted-ca\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029020 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77m4w\" (UniqueName: \"kubernetes.io/projected/3d363a17-8ed8-4831-8c0e-83cf2473018e-kube-api-access-77m4w\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029048 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8t4\" (UniqueName: \"kubernetes.io/projected/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-api-access-cm8t4\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029082 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64d29bc4-41e5-4d33-a634-7f4172ea76ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029190 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5rxw\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-kube-api-access-n5rxw\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029246 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-metrics-tls\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029276 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-image-registry-private-configuration\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029300 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-ca-trust-extracted\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029322 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-certificates\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029343 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64d29bc4-41e5-4d33-a634-7f4172ea76ea-crio-socket\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.029720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029377 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64d29bc4-41e5-4d33-a634-7f4172ea76ea-data-volume\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.029720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029406 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.029720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029635 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-ca-trust-extracted\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.029901 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.029865 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64d29bc4-41e5-4d33-a634-7f4172ea76ea-crio-socket\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.030172 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.030154 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-trusted-ca\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.030260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.030206 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-certificates\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.030260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.030231 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64d29bc4-41e5-4d33-a634-7f4172ea76ea-data-volume\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.030445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.030426 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.033217 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.033188 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64d29bc4-41e5-4d33-a634-7f4172ea76ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.033335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.033279 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-image-registry-private-configuration\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.033445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.033426 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-registry-tls\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.033491 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.033459 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-installation-pull-secrets\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.040646 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.040620 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-bound-sa-token\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.040999 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.040972 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5rxw\" (UniqueName: \"kubernetes.io/projected/b6532fba-d8d4-45fc-ac4f-4e434e486ba9-kube-api-access-n5rxw\") pod \"image-registry-7b47f5b74b-gwcdz\" (UID: \"b6532fba-d8d4-45fc-ac4f-4e434e486ba9\") " pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.041287 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.041270 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8t4\" (UniqueName: \"kubernetes.io/projected/64d29bc4-41e5-4d33-a634-7f4172ea76ea-kube-api-access-cm8t4\") pod \"insights-runtime-extractor-dr6lc\" (UID: \"64d29bc4-41e5-4d33-a634-7f4172ea76ea\") " pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.103807 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.103706 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.125669 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.125635 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dr6lc" Jun 03 15:04:19.130569 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130535 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-metrics-tls\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.130728 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130706 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-tmp-dir\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.130808 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130759 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-config-volume\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.130808 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130789 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkft9\" (UniqueName: \"kubernetes.io/projected/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-kube-api-access-hkft9\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.130912 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130818 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d363a17-8ed8-4831-8c0e-83cf2473018e-cert\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.130912 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.130848 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77m4w\" (UniqueName: \"kubernetes.io/projected/3d363a17-8ed8-4831-8c0e-83cf2473018e-kube-api-access-77m4w\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.131215 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.131170 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-tmp-dir\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.131515 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.131490 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-config-volume\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.133053 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.133017 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-metrics-tls\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.133726 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.133698 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d363a17-8ed8-4831-8c0e-83cf2473018e-cert\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.145613 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.145580 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77m4w\" (UniqueName: \"kubernetes.io/projected/3d363a17-8ed8-4831-8c0e-83cf2473018e-kube-api-access-77m4w\") pod \"ingress-canary-ncp2g\" (UID: \"3d363a17-8ed8-4831-8c0e-83cf2473018e\") " pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.145930 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.145915 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkft9\" (UniqueName: \"kubernetes.io/projected/fcd72871-6d2f-4fc1-bb31-a9fe11b3d785-kube-api-access-hkft9\") pod \"dns-default-hnwr2\" (UID: \"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785\") " pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.163471 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.163435 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ncp2g" Jun 03 15:04:19.233630 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.233600 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:19.317876 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.317687 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dr6lc"] Jun 03 15:04:19.329291 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.329262 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b47f5b74b-gwcdz"] Jun 03 15:04:19.332907 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:19.332860 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6532fba_d8d4_45fc_ac4f_4e434e486ba9.slice/crio-d998a01d7040f2f5c9fe46679d866feec8d4fc128950179f8c69526cfe59a51e WatchSource:0}: Error finding container d998a01d7040f2f5c9fe46679d866feec8d4fc128950179f8c69526cfe59a51e: Status 404 returned error can't find the container with id d998a01d7040f2f5c9fe46679d866feec8d4fc128950179f8c69526cfe59a51e Jun 03 15:04:19.367037 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.367001 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ncp2g"] Jun 03 15:04:19.371448 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:19.371415 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d363a17_8ed8_4831_8c0e_83cf2473018e.slice/crio-61acdf30d218eea08d64715e215b7b5632c3d8f22d75cbf44e598925419b821e WatchSource:0}: Error finding container 61acdf30d218eea08d64715e215b7b5632c3d8f22d75cbf44e598925419b821e: Status 404 returned error can't find the container with id 61acdf30d218eea08d64715e215b7b5632c3d8f22d75cbf44e598925419b821e Jun 03 15:04:19.414866 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.414834 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hnwr2"] Jun 03 15:04:19.418277 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:19.418244 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd72871_6d2f_4fc1_bb31_a9fe11b3d785.slice/crio-7e8c7dbcd29ede10f4a1cc6d37d5004a114a028a71de435992f1c1939cfbd261 WatchSource:0}: Error finding container 7e8c7dbcd29ede10f4a1cc6d37d5004a114a028a71de435992f1c1939cfbd261: Status 404 returned error can't find the container with id 7e8c7dbcd29ede10f4a1cc6d37d5004a114a028a71de435992f1c1939cfbd261 Jun 03 15:04:19.797015 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.796971 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnwr2" event={"ID":"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785","Type":"ContainerStarted","Data":"7e8c7dbcd29ede10f4a1cc6d37d5004a114a028a71de435992f1c1939cfbd261"} Jun 03 15:04:19.797978 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.797952 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncp2g" event={"ID":"3d363a17-8ed8-4831-8c0e-83cf2473018e","Type":"ContainerStarted","Data":"61acdf30d218eea08d64715e215b7b5632c3d8f22d75cbf44e598925419b821e"} Jun 03 15:04:19.799358 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.799325 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dr6lc" event={"ID":"64d29bc4-41e5-4d33-a634-7f4172ea76ea","Type":"ContainerStarted","Data":"39aa27defeada0291fef9eda0f42617c31082ff8d5e8009a965d3e2838c7193e"} Jun 03 15:04:19.799478 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.799362 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dr6lc" event={"ID":"64d29bc4-41e5-4d33-a634-7f4172ea76ea","Type":"ContainerStarted","Data":"8e599b3d96ef6c2ddba6365f592254e00379de095e6228881d7f458ef0a296f7"} Jun 03 15:04:19.800490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.800469 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" event={"ID":"b6532fba-d8d4-45fc-ac4f-4e434e486ba9","Type":"ContainerStarted","Data":"afba09092440797618cca8d592121bb3a9013b4d8c086e6cbc80f580fc88a883"} Jun 03 15:04:19.800490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.800492 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" event={"ID":"b6532fba-d8d4-45fc-ac4f-4e434e486ba9","Type":"ContainerStarted","Data":"d998a01d7040f2f5c9fe46679d866feec8d4fc128950179f8c69526cfe59a51e"} Jun 03 15:04:19.800698 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.800683 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:19.846784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:19.846725 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" podStartSLOduration=6.846706989 podStartE2EDuration="6.846706989s" podCreationTimestamp="2026-06-03 15:04:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:19.845537994 +0000 UTC m=+39.978826896" watchObservedRunningTime="2026-06-03 15:04:19.846706989 +0000 UTC m=+39.979995892" Jun 03 15:04:20.553861 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.553830 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:20.554434 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.554414 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:20.557926 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.557900 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:04:20.558990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.558767 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:04:20.558990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.558815 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:04:20.558990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.558767 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:04:20.558990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.558816 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:04:20.805062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:20.804975 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dr6lc" event={"ID":"64d29bc4-41e5-4d33-a634-7f4172ea76ea","Type":"ContainerStarted","Data":"8d25227335dd586a9915a8148d854ba6d63387246a4b3434270fabf85a0f6345"} Jun 03 15:04:22.811422 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.811380 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ncp2g" event={"ID":"3d363a17-8ed8-4831-8c0e-83cf2473018e","Type":"ContainerStarted","Data":"5af1f3b8c30ae7005b5e257ba8fad87539cb4cd386ce473a814505177956416c"} Jun 03 15:04:22.812765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.812738 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnwr2" event={"ID":"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785","Type":"ContainerStarted","Data":"512d0cc64df87a87c5a858292f0e91b33c6b508e1276c6395fadff3eb4ae9c3f"} Jun 03 15:04:22.812904 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.812769 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnwr2" event={"ID":"fcd72871-6d2f-4fc1-bb31-a9fe11b3d785","Type":"ContainerStarted","Data":"4bf7013d1b6f8c1fcc74e1f9a3d583d5d66f590ffe4551575d013a1ef9be65cd"} Jun 03 15:04:22.812975 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.812945 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:22.906702 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.906649 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ncp2g" podStartSLOduration=2.2193222280000002 podStartE2EDuration="4.90663257s" podCreationTimestamp="2026-06-03 15:04:18 +0000 UTC" firstStartedPulling="2026-06-03 15:04:19.373635294 +0000 UTC m=+39.506924193" lastFinishedPulling="2026-06-03 15:04:22.060945655 +0000 UTC m=+42.194234535" observedRunningTime="2026-06-03 15:04:22.85239095 +0000 UTC m=+42.985679851" watchObservedRunningTime="2026-06-03 15:04:22.90663257 +0000 UTC m=+43.039921470" Jun 03 15:04:22.907054 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:22.907023 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hnwr2" podStartSLOduration=2.269472482 podStartE2EDuration="4.90701353s" podCreationTimestamp="2026-06-03 15:04:18 +0000 UTC" firstStartedPulling="2026-06-03 15:04:19.420625045 +0000 UTC m=+39.553913924" lastFinishedPulling="2026-06-03 15:04:22.058166085 +0000 UTC m=+42.191454972" observedRunningTime="2026-06-03 15:04:22.898068221 +0000 UTC m=+43.031357133" watchObservedRunningTime="2026-06-03 15:04:22.90701353 +0000 UTC m=+43.040302431" Jun 03 15:04:24.078855 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.078820 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rh4vc"] Jun 03 15:04:24.094697 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.094670 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.101079 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.101056 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:04:24.101202 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.101060 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x69pg\"" Jun 03 15:04:24.101202 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.101102 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:04:24.103178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.103156 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:04:24.103276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.103191 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:04:24.110582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.110568 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:04:24.114733 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.114718 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:04:24.168635 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168606 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-sys\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168748 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168666 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-root\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168748 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168687 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168748 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168726 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-wtmp\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168863 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168777 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-textfile\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168863 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168795 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nk5x\" (UniqueName: \"kubernetes.io/projected/658c8eeb-cc18-48a6-a2ad-0bb802624c23-kube-api-access-2nk5x\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168863 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168813 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-metrics-client-ca\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168863 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168830 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.168863 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.168857 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269268 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269238 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-textfile\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269268 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269272 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nk5x\" (UniqueName: \"kubernetes.io/projected/658c8eeb-cc18-48a6-a2ad-0bb802624c23-kube-api-access-2nk5x\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269290 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-metrics-client-ca\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269409 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269454 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269593 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269490 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-sys\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269593 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269564 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-root\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269593 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269576 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-textfile\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269593 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269586 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269628 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-sys\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269641 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-wtmp\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269641 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-root\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:24.269703 2527 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:24.269750 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls podName:658c8eeb-cc18-48a6-a2ad-0bb802624c23 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:24.769735706 +0000 UTC m=+44.903024587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls") pod "node-exporter-rh4vc" (UID: "658c8eeb-cc18-48a6-a2ad-0bb802624c23") : secret "node-exporter-tls" not found Jun 03 15:04:24.269781 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269751 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-wtmp\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.270014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269825 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-metrics-client-ca\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.270014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.269952 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-accelerators-collector-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.271674 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.271655 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.286483 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.286460 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nk5x\" (UniqueName: \"kubernetes.io/projected/658c8eeb-cc18-48a6-a2ad-0bb802624c23-kube-api-access-2nk5x\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.772860 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:24.772827 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:24.773052 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:24.772982 2527 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.773113 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:24.773064 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls podName:658c8eeb-cc18-48a6-a2ad-0bb802624c23 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:25.773041018 +0000 UTC m=+45.906329902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls") pod "node-exporter-rh4vc" (UID: "658c8eeb-cc18-48a6-a2ad-0bb802624c23") : secret "node-exporter-tls" not found Jun 03 15:04:25.220077 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.220038 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:04:25.262103 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.262068 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:04:25.262300 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.262231 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.266273 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.266246 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:04:25.266410 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.266276 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:04:25.266498 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.266484 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:04:25.266670 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.266656 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:04:25.266739 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.266670 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:04:25.267809 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.267784 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:04:25.267911 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.267840 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:04:25.267911 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.267871 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:04:25.267997 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.267989 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-twg85\"" Jun 03 15:04:25.268144 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.268117 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:04:25.275864 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.275844 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.275977 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.275877 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.275977 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.275904 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.275977 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.275964 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.275991 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276028 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276062 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276148 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276180 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276210 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276234 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276283 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d7q5\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.276346 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.276312 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376726 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376690 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376726 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376727 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376775 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376794 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376819 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376834 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376856 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6d7q5\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376883 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376938 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.376970 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376963 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377354 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.376989 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377354 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.377014 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377354 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.377037 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377724 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.377645 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377862 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.377737 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.377862 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:25.377758 2527 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 15:04:25.377862 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:25.377832 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls podName:be0105d6-cd32-42ce-a232-6271c90cdc1d nodeName:}" failed. No retries permitted until 2026-06-03 15:04:25.877808589 +0000 UTC m=+46.011097478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d") : secret "alertmanager-main-tls" not found Jun 03 15:04:25.378179 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:04:25.377885 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle podName:be0105d6-cd32-42ce-a232-6271c90cdc1d nodeName:}" failed. No retries permitted until 2026-06-03 15:04:25.877865865 +0000 UTC m=+46.011154750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d") : configmap references non-existent config key: ca-bundle.crt Jun 03 15:04:25.380097 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380057 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380097 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380077 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380479 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380458 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380662 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380640 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380739 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380714 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380788 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380718 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.380830 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.380784 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.381248 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.381231 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.393542 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.390399 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d7q5\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.779369 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.779332 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:25.781624 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.781578 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/658c8eeb-cc18-48a6-a2ad-0bb802624c23-node-exporter-tls\") pod \"node-exporter-rh4vc\" (UID: \"658c8eeb-cc18-48a6-a2ad-0bb802624c23\") " pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:25.880190 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.880126 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.880362 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.880299 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.881167 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.881124 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.882551 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.882532 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:25.903487 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:25.903449 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rh4vc" Jun 03 15:04:25.928250 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:25.928215 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658c8eeb_cc18_48a6_a2ad_0bb802624c23.slice/crio-51ec79d49c76fb062f825ca6cbfa52472b4ade30cf73a80a4b29cac51eb658ce WatchSource:0}: Error finding container 51ec79d49c76fb062f825ca6cbfa52472b4ade30cf73a80a4b29cac51eb658ce: Status 404 returned error can't find the container with id 51ec79d49c76fb062f825ca6cbfa52472b4ade30cf73a80a4b29cac51eb658ce Jun 03 15:04:26.171723 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:26.171632 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:04:26.338720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:26.338684 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:04:26.341282 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:26.341256 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0105d6_cd32_42ce_a232_6271c90cdc1d.slice/crio-b3926a5a1b47b4d80475f9b2a326abb036254104623de657679205f4fef9cb8a WatchSource:0}: Error finding container b3926a5a1b47b4d80475f9b2a326abb036254104623de657679205f4fef9cb8a: Status 404 returned error can't find the container with id b3926a5a1b47b4d80475f9b2a326abb036254104623de657679205f4fef9cb8a Jun 03 15:04:26.824099 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:26.824051 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh4vc" event={"ID":"658c8eeb-cc18-48a6-a2ad-0bb802624c23","Type":"ContainerStarted","Data":"51ec79d49c76fb062f825ca6cbfa52472b4ade30cf73a80a4b29cac51eb658ce"} Jun 03 15:04:26.825319 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:26.825291 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"b3926a5a1b47b4d80475f9b2a326abb036254104623de657679205f4fef9cb8a"} Jun 03 15:04:27.106683 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.106595 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-db679d668-nh8bf"] Jun 03 15:04:27.144507 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.144465 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db679d668-nh8bf"] Jun 03 15:04:27.144687 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.144672 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.151761 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.151722 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 15:04:27.152087 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.152029 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b0hpuk7jem3gk\"" Jun 03 15:04:27.152274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.152256 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 15:04:27.152649 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.152628 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 15:04:27.153526 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.153506 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 15:04:27.153618 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.153562 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 15:04:27.153618 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.153506 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g2drl\"" Jun 03 15:04:27.191171 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191105 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-grpc-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191368 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191184 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191368 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191360 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f516f271-9e62-412b-acff-04ecfe44b74f-metrics-client-ca\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191469 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191396 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191469 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191453 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191533 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191485 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v687v\" (UniqueName: \"kubernetes.io/projected/f516f271-9e62-412b-acff-04ecfe44b74f-kube-api-access-v687v\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191533 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191520 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.191629 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.191609 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292476 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292437 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292676 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292497 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292676 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292528 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v687v\" (UniqueName: \"kubernetes.io/projected/f516f271-9e62-412b-acff-04ecfe44b74f-kube-api-access-v687v\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292676 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292559 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292676 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292604 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292676 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292649 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-grpc-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292901 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292681 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.292901 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.292715 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f516f271-9e62-412b-acff-04ecfe44b74f-metrics-client-ca\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.293518 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.293487 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f516f271-9e62-412b-acff-04ecfe44b74f-metrics-client-ca\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.295626 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.295602 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.296170 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.296104 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.296280 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.296179 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.296347 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.296320 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.296407 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.296339 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-grpc-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.296656 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.296633 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f516f271-9e62-412b-acff-04ecfe44b74f-secret-thanos-querier-tls\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.310663 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.310631 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v687v\" (UniqueName: \"kubernetes.io/projected/f516f271-9e62-412b-acff-04ecfe44b74f-kube-api-access-v687v\") pod \"thanos-querier-db679d668-nh8bf\" (UID: \"f516f271-9e62-412b-acff-04ecfe44b74f\") " pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:27.456891 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:27.456844 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:28.437499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.437466 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6bdf5d767f-vqd6z"] Jun 03 15:04:28.456064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.456023 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bdf5d767f-vqd6z"] Jun 03 15:04:28.456252 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.456196 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.461978 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.461947 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 15:04:28.462378 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.461997 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pwn2c\"" Jun 03 15:04:28.462378 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.462144 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 15:04:28.463347 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.463330 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:04:28.463448 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.463419 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ek1kv8p5o0g02\"" Jun 03 15:04:28.466927 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.466910 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 15:04:28.502888 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.502838 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.502921 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-tls\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.502951 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-metrics-server-audit-profiles\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.503027 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-client-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503062 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.503060 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpf5\" (UniqueName: \"kubernetes.io/projected/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-kube-api-access-jwpf5\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503242 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.503080 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-audit-log\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.503242 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.503149 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-client-certs\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.603853 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.603929 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-tls\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.603958 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-metrics-server-audit-profiles\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604309 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.604021 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-client-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604309 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.604050 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpf5\" (UniqueName: \"kubernetes.io/projected/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-kube-api-access-jwpf5\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604309 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.604237 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-audit-log\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604749 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.604330 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-client-certs\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.604830 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.604802 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.605989 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.605787 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-audit-log\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.605989 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.605922 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-metrics-server-audit-profiles\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.609220 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.609160 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-client-ca-bundle\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.609402 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.609311 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-tls\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.610032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.609995 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-secret-metrics-server-client-certs\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.618849 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.618817 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpf5\" (UniqueName: \"kubernetes.io/projected/d8ba560f-3851-41cc-a46f-75f3fc2ed34a-kube-api-access-jwpf5\") pod \"metrics-server-6bdf5d767f-vqd6z\" (UID: \"d8ba560f-3851-41cc-a46f-75f3fc2ed34a\") " pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.716497 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.716466 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db679d668-nh8bf"] Jun 03 15:04:28.728858 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:28.728790 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf516f271_9e62_412b_acff_04ecfe44b74f.slice/crio-fd9e1dd3a660b55640875fba670fdfb46b57b2d238b5de21637921c809fdad37 WatchSource:0}: Error finding container fd9e1dd3a660b55640875fba670fdfb46b57b2d238b5de21637921c809fdad37: Status 404 returned error can't find the container with id fd9e1dd3a660b55640875fba670fdfb46b57b2d238b5de21637921c809fdad37 Jun 03 15:04:28.765478 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.765434 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:28.833318 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.833218 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dr6lc" event={"ID":"64d29bc4-41e5-4d33-a634-7f4172ea76ea","Type":"ContainerStarted","Data":"189f6a6e8d8dd81dd3ac23667a25c4ea0098378c25349273277cecfcba96404c"} Jun 03 15:04:28.834877 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.834848 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3" exitCode=0 Jun 03 15:04:28.835003 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.834918 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3"} Jun 03 15:04:28.836828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.836806 2527 generic.go:358] "Generic (PLEG): container finished" podID="658c8eeb-cc18-48a6-a2ad-0bb802624c23" containerID="29fdeeae2a772384c7bd7323fb65e7bbeac59b2db300b248174724257624ea5d" exitCode=0 Jun 03 15:04:28.836934 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.836906 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh4vc" event={"ID":"658c8eeb-cc18-48a6-a2ad-0bb802624c23","Type":"ContainerDied","Data":"29fdeeae2a772384c7bd7323fb65e7bbeac59b2db300b248174724257624ea5d"} Jun 03 15:04:28.838149 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.838056 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"fd9e1dd3a660b55640875fba670fdfb46b57b2d238b5de21637921c809fdad37"} Jun 03 15:04:28.887927 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.887879 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dr6lc" podStartSLOduration=1.799103852 podStartE2EDuration="10.887863063s" podCreationTimestamp="2026-06-03 15:04:18 +0000 UTC" firstStartedPulling="2026-06-03 15:04:19.473687635 +0000 UTC m=+39.606976527" lastFinishedPulling="2026-06-03 15:04:28.562446858 +0000 UTC m=+48.695735738" observedRunningTime="2026-06-03 15:04:28.887241944 +0000 UTC m=+49.020530846" watchObservedRunningTime="2026-06-03 15:04:28.887863063 +0000 UTC m=+49.021151964" Jun 03 15:04:28.904814 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:28.904787 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bdf5d767f-vqd6z"] Jun 03 15:04:28.908571 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:28.908538 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ba560f_3851_41cc_a46f_75f3fc2ed34a.slice/crio-ec922052cd1dcc34beeb706d50cdf16c02b489e1de8a99374a1ba09bd479e877 WatchSource:0}: Error finding container ec922052cd1dcc34beeb706d50cdf16c02b489e1de8a99374a1ba09bd479e877: Status 404 returned error can't find the container with id ec922052cd1dcc34beeb706d50cdf16c02b489e1de8a99374a1ba09bd479e877 Jun 03 15:04:29.177827 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.177744 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-558c55cf67-kfcvx"] Jun 03 15:04:29.200064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.200023 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-558c55cf67-kfcvx"] Jun 03 15:04:29.200231 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.200174 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.203451 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203417 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dqjpb\"" Jun 03 15:04:29.203585 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203498 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 15:04:29.203585 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203574 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 15:04:29.203829 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203813 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 15:04:29.203910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203892 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 15:04:29.203967 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.203892 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 15:04:29.209336 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.209316 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 15:04:29.210212 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210192 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210275 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210226 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mm4l\" (UniqueName: \"kubernetes.io/projected/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-kube-api-access-9mm4l\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210275 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210247 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-metrics-client-ca\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210348 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210273 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-serving-certs-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210348 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210293 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210348 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210309 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-federate-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210361 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.210445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.210423 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311292 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311248 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311475 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311336 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311540 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311512 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mm4l\" (UniqueName: \"kubernetes.io/projected/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-kube-api-access-9mm4l\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311591 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311566 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-metrics-client-ca\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311645 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311600 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-serving-certs-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311645 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311632 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311740 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311660 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-federate-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.311791 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.311745 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.312454 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.312426 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-metrics-client-ca\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.312641 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.312456 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-serving-certs-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.312741 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.312725 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.314011 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.313985 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.314219 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.314200 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-telemeter-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.314397 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.314378 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-secret-telemeter-client\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.314473 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.314449 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-federate-client-tls\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.321415 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.321396 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mm4l\" (UniqueName: \"kubernetes.io/projected/95ca318d-f1ff-49e9-aebc-a9b6b72d32d1-kube-api-access-9mm4l\") pod \"telemeter-client-558c55cf67-kfcvx\" (UID: \"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1\") " pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.509310 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.509270 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" Jun 03 15:04:29.668980 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.668945 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-558c55cf67-kfcvx"] Jun 03 15:04:29.672739 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:29.672714 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ca318d_f1ff_49e9_aebc_a9b6b72d32d1.slice/crio-aef3efab0f3154656b0afefb56d6b63b0cfbfc045bcb2f57d13519d9ef4d2bf9 WatchSource:0}: Error finding container aef3efab0f3154656b0afefb56d6b63b0cfbfc045bcb2f57d13519d9ef4d2bf9: Status 404 returned error can't find the container with id aef3efab0f3154656b0afefb56d6b63b0cfbfc045bcb2f57d13519d9ef4d2bf9 Jun 03 15:04:29.843440 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.843353 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" event={"ID":"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1","Type":"ContainerStarted","Data":"aef3efab0f3154656b0afefb56d6b63b0cfbfc045bcb2f57d13519d9ef4d2bf9"} Jun 03 15:04:29.845885 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.845852 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh4vc" event={"ID":"658c8eeb-cc18-48a6-a2ad-0bb802624c23","Type":"ContainerStarted","Data":"d44b37fb43ad8a5ac5db07714fa8a5758584f4128247883af0d040de3c3b35e8"} Jun 03 15:04:29.846043 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.845891 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rh4vc" event={"ID":"658c8eeb-cc18-48a6-a2ad-0bb802624c23","Type":"ContainerStarted","Data":"ae2cc7df376a933515f537f98d4de079cc5fb1d1b06ab9be858d54f17eeae16d"} Jun 03 15:04:29.847606 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.847568 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" event={"ID":"d8ba560f-3851-41cc-a46f-75f3fc2ed34a","Type":"ContainerStarted","Data":"ec922052cd1dcc34beeb706d50cdf16c02b489e1de8a99374a1ba09bd479e877"} Jun 03 15:04:29.882486 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:29.882425 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rh4vc" podStartSLOduration=4.2517642030000005 podStartE2EDuration="6.8824093s" podCreationTimestamp="2026-06-03 15:04:23 +0000 UTC" firstStartedPulling="2026-06-03 15:04:25.929858 +0000 UTC m=+46.063146879" lastFinishedPulling="2026-06-03 15:04:28.560503093 +0000 UTC m=+48.693791976" observedRunningTime="2026-06-03 15:04:29.881629762 +0000 UTC m=+50.014918666" watchObservedRunningTime="2026-06-03 15:04:29.8824093 +0000 UTC m=+50.015698202" Jun 03 15:04:31.854013 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:31.853966 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" event={"ID":"d8ba560f-3851-41cc-a46f-75f3fc2ed34a","Type":"ContainerStarted","Data":"b87ea78309a6608653db5ac0f3470cd02a5ee8a71fb60a1054fe8c29c8ac0bb0"} Jun 03 15:04:31.891722 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:31.891665 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" podStartSLOduration=1.568683555 podStartE2EDuration="3.891647334s" podCreationTimestamp="2026-06-03 15:04:28 +0000 UTC" firstStartedPulling="2026-06-03 15:04:28.910118339 +0000 UTC m=+49.043407218" lastFinishedPulling="2026-06-03 15:04:31.233082108 +0000 UTC m=+51.366370997" observedRunningTime="2026-06-03 15:04:31.890259236 +0000 UTC m=+52.023548136" watchObservedRunningTime="2026-06-03 15:04:31.891647334 +0000 UTC m=+52.024936236" Jun 03 15:04:32.817554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.817423 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hnwr2" Jun 03 15:04:32.858613 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.858576 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" event={"ID":"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1","Type":"ContainerStarted","Data":"3b4370789d7287dd636bcbbae89d8b833c63a0263a36f3c74bae3c61e714d2e6"} Jun 03 15:04:32.858613 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.858613 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" event={"ID":"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1","Type":"ContainerStarted","Data":"60d03ff10786a7e1b6b7bccfaccc5c800fb91efcec435ad8d8eafb4c05b02b86"} Jun 03 15:04:32.859044 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.858624 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" event={"ID":"95ca318d-f1ff-49e9-aebc-a9b6b72d32d1","Type":"ContainerStarted","Data":"d89c3b74e0f30776a3e850b44c18cca0c51e74d861908141b395414a9438ebad"} Jun 03 15:04:32.860428 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.860400 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"c8edc43444d0fae20c0337a141461fe101fc3796742a2bf45ddadf0de72e497b"} Jun 03 15:04:32.860537 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.860436 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"3688267cdd0d89da8afc46966dc32f9809e8467c2f8ef2160a6bf372bc744766"} Jun 03 15:04:32.860537 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.860450 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"bb432d05c6695eca1e5d9d1fc2a1f10a8c3c2109a06a3093fb1e9e14ec86b4f8"} Jun 03 15:04:32.935301 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:32.935244 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-558c55cf67-kfcvx" podStartSLOduration=1.083571646 podStartE2EDuration="3.935226619s" podCreationTimestamp="2026-06-03 15:04:29 +0000 UTC" firstStartedPulling="2026-06-03 15:04:29.675606955 +0000 UTC m=+49.808895839" lastFinishedPulling="2026-06-03 15:04:32.527261921 +0000 UTC m=+52.660550812" observedRunningTime="2026-06-03 15:04:32.934835858 +0000 UTC m=+53.068124758" watchObservedRunningTime="2026-06-03 15:04:32.935226619 +0000 UTC m=+53.068515520" Jun 03 15:04:33.865518 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:33.865487 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"efc11b87d6dfc73149febcf09bed7cf0d323c0155f4bf4845c06421256f03693"} Jun 03 15:04:33.865884 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:33.865524 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"6fc2cb00a200439d943bc491aa3ee813ff56ef0ca47ad4f80fe81c7a2934e990"} Jun 03 15:04:34.870406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:34.870365 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" event={"ID":"f516f271-9e62-412b-acff-04ecfe44b74f","Type":"ContainerStarted","Data":"42f429cfbaf3c596d6d23be72445301e19df9b5dffb45a31cb49af92d5df5389"} Jun 03 15:04:34.870797 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:34.870643 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:34.926244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:34.926180 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" podStartSLOduration=2.948183069 podStartE2EDuration="7.926160363s" podCreationTimestamp="2026-06-03 15:04:27 +0000 UTC" firstStartedPulling="2026-06-03 15:04:28.731005991 +0000 UTC m=+48.864294873" lastFinishedPulling="2026-06-03 15:04:33.708983277 +0000 UTC m=+53.842272167" observedRunningTime="2026-06-03 15:04:34.925327142 +0000 UTC m=+55.058616043" watchObservedRunningTime="2026-06-03 15:04:34.926160363 +0000 UTC m=+55.059449266" Jun 03 15:04:39.778410 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:39.778381 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wcfq7" Jun 03 15:04:40.809058 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:40.809026 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b47f5b74b-gwcdz" Jun 03 15:04:40.882412 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:40.882385 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-db679d668-nh8bf" Jun 03 15:04:45.256878 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.256844 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:45.260468 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.260448 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:04:45.269795 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.269767 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2760330-a219-489c-921b-65a7676e0847-metrics-certs\") pod \"network-metrics-daemon-t845l\" (UID: \"f2760330-a219-489c-921b-65a7676e0847\") " pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:45.357404 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.357373 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:45.360827 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.360811 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:04:45.372505 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.372485 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:04:45.380913 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.380895 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntk7\" (UniqueName: \"kubernetes.io/projected/7469f4f6-b163-41c1-991c-30faca027d10-kube-api-access-5ntk7\") pod \"network-check-target-9svkl\" (UID: \"7469f4f6-b163-41c1-991c-30faca027d10\") " pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:45.488931 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.488909 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:04:45.495203 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.495178 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:04:45.495928 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.495913 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t845l" Jun 03 15:04:45.502087 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.502067 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:45.649443 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.649419 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t845l"] Jun 03 15:04:45.651088 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:45.651062 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2760330_a219_489c_921b_65a7676e0847.slice/crio-a1a7c5693aac46aa7c97bb7e7b5299399863be153b3e475d5fe3621e306dd1ea WatchSource:0}: Error finding container a1a7c5693aac46aa7c97bb7e7b5299399863be153b3e475d5fe3621e306dd1ea: Status 404 returned error can't find the container with id a1a7c5693aac46aa7c97bb7e7b5299399863be153b3e475d5fe3621e306dd1ea Jun 03 15:04:45.668000 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.667979 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9svkl"] Jun 03 15:04:45.670582 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:04:45.670561 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7469f4f6_b163_41c1_991c_30faca027d10.slice/crio-889ef78c978b6a12ef1516ff07f6a488209ac3d0e729363392040fed171fa2cf WatchSource:0}: Error finding container 889ef78c978b6a12ef1516ff07f6a488209ac3d0e729363392040fed171fa2cf: Status 404 returned error can't find the container with id 889ef78c978b6a12ef1516ff07f6a488209ac3d0e729363392040fed171fa2cf Jun 03 15:04:45.902785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.902700 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9svkl" event={"ID":"7469f4f6-b163-41c1-991c-30faca027d10","Type":"ContainerStarted","Data":"889ef78c978b6a12ef1516ff07f6a488209ac3d0e729363392040fed171fa2cf"} Jun 03 15:04:45.903686 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:45.903664 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t845l" event={"ID":"f2760330-a219-489c-921b-65a7676e0847","Type":"ContainerStarted","Data":"a1a7c5693aac46aa7c97bb7e7b5299399863be153b3e475d5fe3621e306dd1ea"} Jun 03 15:04:48.766582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:48.766545 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:48.766582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:48.766591 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:04:49.917274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.917194 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t845l" event={"ID":"f2760330-a219-489c-921b-65a7676e0847","Type":"ContainerStarted","Data":"1eeefd32989584a717dae57831bb207e0ff93088bc9e845ed2543410bb10e430"} Jun 03 15:04:49.917274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.917231 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t845l" event={"ID":"f2760330-a219-489c-921b-65a7676e0847","Type":"ContainerStarted","Data":"37144fa6cdfce47fa607f03bdb8f0a5bef28234ecc4f3ab54a4f08e0a79a5f38"} Jun 03 15:04:49.919890 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919868 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212"} Jun 03 15:04:49.919957 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919896 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652"} Jun 03 15:04:49.919957 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919905 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb"} Jun 03 15:04:49.919957 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919914 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3"} Jun 03 15:04:49.919957 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919925 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424"} Jun 03 15:04:49.919957 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.919938 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerStarted","Data":"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450"} Jun 03 15:04:49.921107 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.921080 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9svkl" event={"ID":"7469f4f6-b163-41c1-991c-30faca027d10","Type":"ContainerStarted","Data":"d64a59ac88b1f3263c10593c57599cf09a0f76dc447c3de39fadb0148e13f2da"} Jun 03 15:04:49.921232 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.921211 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:04:49.939343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.939301 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t845l" podStartSLOduration=66.332508947 podStartE2EDuration="1m9.939288744s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:04:45.653046894 +0000 UTC m=+65.786335772" lastFinishedPulling="2026-06-03 15:04:49.259826691 +0000 UTC m=+69.393115569" observedRunningTime="2026-06-03 15:04:49.937171934 +0000 UTC m=+70.070460834" watchObservedRunningTime="2026-06-03 15:04:49.939288744 +0000 UTC m=+70.072577645" Jun 03 15:04:49.954483 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.954448 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9svkl" podStartSLOduration=66.369414506 podStartE2EDuration="1m9.954438231s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:04:45.672364239 +0000 UTC m=+65.805653117" lastFinishedPulling="2026-06-03 15:04:49.257387954 +0000 UTC m=+69.390676842" observedRunningTime="2026-06-03 15:04:49.954114508 +0000 UTC m=+70.087403409" watchObservedRunningTime="2026-06-03 15:04:49.954438231 +0000 UTC m=+70.087727174" Jun 03 15:04:49.991000 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:04:49.990960 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.074099561 podStartE2EDuration="24.990948846s" podCreationTimestamp="2026-06-03 15:04:25 +0000 UTC" firstStartedPulling="2026-06-03 15:04:26.343029006 +0000 UTC m=+46.476317885" lastFinishedPulling="2026-06-03 15:04:49.259878291 +0000 UTC m=+69.393167170" observedRunningTime="2026-06-03 15:04:49.990788416 +0000 UTC m=+70.124077317" watchObservedRunningTime="2026-06-03 15:04:49.990948846 +0000 UTC m=+70.124237747" Jun 03 15:05:08.770835 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:08.770706 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:05:08.774602 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:08.774582 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6bdf5d767f-vqd6z" Jun 03 15:05:20.926285 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:20.926252 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9svkl" Jun 03 15:05:44.516374 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516334 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516767 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="alertmanager" containerID="cri-o://2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450" gracePeriod=120 Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516825 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-metric" containerID="cri-o://7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652" gracePeriod=120 Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516874 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy" containerID="cri-o://4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb" gracePeriod=120 Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516825 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="prom-label-proxy" containerID="cri-o://3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212" gracePeriod=120 Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516881 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="config-reloader" containerID="cri-o://42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424" gracePeriod=120 Jun 03 15:05:44.516951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:44.516878 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-web" containerID="cri-o://1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3" gracePeriod=120 Jun 03 15:05:45.072638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072606 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212" exitCode=0 Jun 03 15:05:45.072638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072632 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652" exitCode=0 Jun 03 15:05:45.072638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072639 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb" exitCode=0 Jun 03 15:05:45.072638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072644 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424" exitCode=0 Jun 03 15:05:45.072638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072650 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450" exitCode=0 Jun 03 15:05:45.072918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072682 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212"} Jun 03 15:05:45.072918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072716 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652"} Jun 03 15:05:45.072918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072726 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb"} Jun 03 15:05:45.072918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072735 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424"} Jun 03 15:05:45.072918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.072743 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450"} Jun 03 15:05:45.749552 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.749531 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:45.830595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830566 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830618 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830638 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830659 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830678 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830712 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830735 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.830765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830765 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.831127 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830793 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d7q5\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.831127 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830818 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.831127 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830856 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.831127 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830902 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.831127 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.830934 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db\") pod \"be0105d6-cd32-42ce-a232-6271c90cdc1d\" (UID: \"be0105d6-cd32-42ce-a232-6271c90cdc1d\") " Jun 03 15:05:45.832162 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.831026 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:45.832537 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.832505 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:05:45.833027 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.832999 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:45.834783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.834238 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:45.834783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.834379 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.837273 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.836779 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out" (OuterVolumeSpecName: "config-out") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:05:45.837791 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.837769 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.838204 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.837760 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5" (OuterVolumeSpecName: "kube-api-access-6d7q5") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "kube-api-access-6d7q5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:45.838204 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.837794 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume" (OuterVolumeSpecName: "config-volume") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.838204 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.837872 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.839529 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.838799 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.843890 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.843864 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.847353 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.847331 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config" (OuterVolumeSpecName: "web-config") pod "be0105d6-cd32-42ce-a232-6271c90cdc1d" (UID: "be0105d6-cd32-42ce-a232-6271c90cdc1d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:45.933178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933109 2527 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933146 2527 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-tls-assets\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933156 2527 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-cluster-tls-config\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933165 2527 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-web-config\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933175 2527 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933183 2527 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-volume\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933192 2527 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-main-tls\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933201 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d7q5\" (UniqueName: \"kubernetes.io/projected/be0105d6-cd32-42ce-a232-6271c90cdc1d-kube-api-access-6d7q5\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933209 2527 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-config-out\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933218 2527 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933226 2527 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be0105d6-cd32-42ce-a232-6271c90cdc1d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933235 2527 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be0105d6-cd32-42ce-a232-6271c90cdc1d-alertmanager-main-db\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:45.933377 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:45.933244 2527 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be0105d6-cd32-42ce-a232-6271c90cdc1d-metrics-client-ca\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:05:46.077883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.077854 2527 generic.go:358] "Generic (PLEG): container finished" podID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerID="1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3" exitCode=0 Jun 03 15:05:46.077981 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.077930 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3"} Jun 03 15:05:46.077981 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.077958 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be0105d6-cd32-42ce-a232-6271c90cdc1d","Type":"ContainerDied","Data":"b3926a5a1b47b4d80475f9b2a326abb036254104623de657679205f4fef9cb8a"} Jun 03 15:05:46.078094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.077982 2527 scope.go:117] "RemoveContainer" containerID="3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212" Jun 03 15:05:46.078094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.078008 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.086172 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.086145 2527 scope.go:117] "RemoveContainer" containerID="7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652" Jun 03 15:05:46.092984 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.092967 2527 scope.go:117] "RemoveContainer" containerID="4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb" Jun 03 15:05:46.099322 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.099308 2527 scope.go:117] "RemoveContainer" containerID="1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3" Jun 03 15:05:46.105395 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.105317 2527 scope.go:117] "RemoveContainer" containerID="42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424" Jun 03 15:05:46.106052 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.106028 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:46.111590 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.111568 2527 scope.go:117] "RemoveContainer" containerID="2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450" Jun 03 15:05:46.112813 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.112795 2527 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:46.117805 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.117787 2527 scope.go:117] "RemoveContainer" containerID="fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3" Jun 03 15:05:46.123781 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.123766 2527 scope.go:117] "RemoveContainer" containerID="3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212" Jun 03 15:05:46.124012 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.123995 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212\": container with ID starting with 3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212 not found: ID does not exist" containerID="3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212" Jun 03 15:05:46.124059 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124026 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212"} err="failed to get container status \"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212\": rpc error: code = NotFound desc = could not find container \"3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212\": container with ID starting with 3a6be36e33d5af08bfba898662508f2e23a00bdfaf3699ed102859eff9297212 not found: ID does not exist" Jun 03 15:05:46.124059 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124056 2527 scope.go:117] "RemoveContainer" containerID="7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652" Jun 03 15:05:46.124311 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.124294 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652\": container with ID starting with 7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652 not found: ID does not exist" containerID="7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652" Jun 03 15:05:46.124354 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124317 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652"} err="failed to get container status \"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652\": rpc error: code = NotFound desc = could not find container \"7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652\": container with ID starting with 7aecbfba612a130508e77c501092c6b66b2112451d0a50fa982842ba3403e652 not found: ID does not exist" Jun 03 15:05:46.124354 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124333 2527 scope.go:117] "RemoveContainer" containerID="4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb" Jun 03 15:05:46.124558 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.124542 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb\": container with ID starting with 4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb not found: ID does not exist" containerID="4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb" Jun 03 15:05:46.124609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124561 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb"} err="failed to get container status \"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb\": rpc error: code = NotFound desc = could not find container \"4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb\": container with ID starting with 4c788332a4754ebc47f2a0e9256108c0080cf1b07b39b917e82331d09bffcdfb not found: ID does not exist" Jun 03 15:05:46.124609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124575 2527 scope.go:117] "RemoveContainer" containerID="1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3" Jun 03 15:05:46.124755 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.124740 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3\": container with ID starting with 1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3 not found: ID does not exist" containerID="1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3" Jun 03 15:05:46.124792 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124759 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3"} err="failed to get container status \"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3\": rpc error: code = NotFound desc = could not find container \"1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3\": container with ID starting with 1a39f183846764910119536b7c850b9d0bbfda38a7654a282e26baadaa021be3 not found: ID does not exist" Jun 03 15:05:46.124792 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.124772 2527 scope.go:117] "RemoveContainer" containerID="42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424" Jun 03 15:05:46.124998 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.124982 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424\": container with ID starting with 42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424 not found: ID does not exist" containerID="42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424" Jun 03 15:05:46.125043 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.125003 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424"} err="failed to get container status \"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424\": rpc error: code = NotFound desc = could not find container \"42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424\": container with ID starting with 42071f8e7994ce17d9debecca83f276eb75f405835127a059cda1ff322571424 not found: ID does not exist" Jun 03 15:05:46.125043 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.125016 2527 scope.go:117] "RemoveContainer" containerID="2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450" Jun 03 15:05:46.125193 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.125179 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450\": container with ID starting with 2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450 not found: ID does not exist" containerID="2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450" Jun 03 15:05:46.125241 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.125195 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450"} err="failed to get container status \"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450\": rpc error: code = NotFound desc = could not find container \"2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450\": container with ID starting with 2cdd59f4407ab5cbcc4e53ccd55e1458ae6ed6ff33281c411e47989d6b8d2450 not found: ID does not exist" Jun 03 15:05:46.125241 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.125207 2527 scope.go:117] "RemoveContainer" containerID="fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3" Jun 03 15:05:46.125394 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:05:46.125376 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3\": container with ID starting with fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3 not found: ID does not exist" containerID="fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3" Jun 03 15:05:46.125441 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.125404 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3"} err="failed to get container status \"fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3\": rpc error: code = NotFound desc = could not find container \"fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3\": container with ID starting with fe9111a28c761e14cd92cb2c67d5ffd1e4e13f77ba28301276ba99de40895ed3 not found: ID does not exist" Jun 03 15:05:46.154285 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154263 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:46.154545 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154533 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="alertmanager" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154547 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="alertmanager" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154561 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-metric" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154569 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-metric" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154583 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-web" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154588 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-web" Jun 03 15:05:46.154595 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154595 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="init-config-reloader" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154600 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="init-config-reloader" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154608 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="prom-label-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154614 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="prom-label-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154620 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="config-reloader" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154625 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="config-reloader" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154635 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154644 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154689 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154697 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="config-reloader" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154703 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="alertmanager" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154709 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-metric" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154719 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="prom-label-proxy" Jun 03 15:05:46.154783 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.154727 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" containerName="kube-rbac-proxy-web" Jun 03 15:05:46.158301 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.158287 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.163323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163290 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:05:46.163429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163335 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:05:46.163429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163352 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-twg85\"" Jun 03 15:05:46.163429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163378 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:05:46.163429 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163390 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:05:46.163610 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163439 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:05:46.163697 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163684 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:05:46.163757 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163686 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:05:46.163932 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.163916 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:05:46.171556 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.171536 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:05:46.176590 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.176569 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:46.235607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235585 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm44k\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-kube-api-access-vm44k\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235615 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235640 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235686 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235839 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235729 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235839 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235750 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235839 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235781 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235839 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235810 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-config-volume\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.235839 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235824 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.236047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235871 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-web-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.236047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235933 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.236047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.235989 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-config-out\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.236047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.236027 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336526 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-config-out\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336717 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336579 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336717 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336616 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm44k\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-kube-api-access-vm44k\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336717 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336644 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336717 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336671 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336926 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336724 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.336926 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336773 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337027 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.336990 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337077 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337036 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337150 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337086 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337224 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337160 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-config-volume\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337224 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337189 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337224 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337214 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-web-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337358 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337242 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.337895 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.337837 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.338333 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.338310 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2838c822-6b3e-43be-9726-9cb2ba952300-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.339409 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.339387 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2838c822-6b3e-43be-9726-9cb2ba952300-config-out\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.339703 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.339651 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.339806 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.339736 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.339914 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.339885 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.340078 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.340060 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.340264 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.340247 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.340763 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.340742 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.340870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.340848 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-web-config\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.341492 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.341477 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2838c822-6b3e-43be-9726-9cb2ba952300-config-volume\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.350002 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.349982 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm44k\" (UniqueName: \"kubernetes.io/projected/2838c822-6b3e-43be-9726-9cb2ba952300-kube-api-access-vm44k\") pod \"alertmanager-main-0\" (UID: \"2838c822-6b3e-43be-9726-9cb2ba952300\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.466551 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.466525 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:05:46.545737 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.545708 2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0105d6-cd32-42ce-a232-6271c90cdc1d" path="/var/lib/kubelet/pods/be0105d6-cd32-42ce-a232-6271c90cdc1d/volumes" Jun 03 15:05:46.597508 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:46.597483 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:05:46.600023 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:05:46.599997 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2838c822_6b3e_43be_9726_9cb2ba952300.slice/crio-20f7b195109120daa8a31100577d1d97a716e65c0ddcc2e9065197d3cce456d5 WatchSource:0}: Error finding container 20f7b195109120daa8a31100577d1d97a716e65c0ddcc2e9065197d3cce456d5: Status 404 returned error can't find the container with id 20f7b195109120daa8a31100577d1d97a716e65c0ddcc2e9065197d3cce456d5 Jun 03 15:05:47.082120 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:47.082082 2527 generic.go:358] "Generic (PLEG): container finished" podID="2838c822-6b3e-43be-9726-9cb2ba952300" containerID="528eeefac05199d2d3e62685ee9f713e6cd91f24fd8b99162aff67d73ae097bb" exitCode=0 Jun 03 15:05:47.082496 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:47.082164 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerDied","Data":"528eeefac05199d2d3e62685ee9f713e6cd91f24fd8b99162aff67d73ae097bb"} Jun 03 15:05:47.082496 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:47.082187 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"20f7b195109120daa8a31100577d1d97a716e65c0ddcc2e9065197d3cce456d5"} Jun 03 15:05:48.088032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.087997 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"d1d66a2c5f03749b7aeb8e28f599b5b699ae4bf82a38896bc108408547565637"} Jun 03 15:05:48.088032 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.088035 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"f389735bae438bbd73cbfdea49e4864f7398e15f35924818ab8505620699088c"} Jun 03 15:05:48.088426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.088049 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"66873f885b29009b7ca5af80522325be99b4e49a374cdbf1bfcec781e0e52e43"} Jun 03 15:05:48.088426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.088058 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"d1f8baeef4adc6a7514a35a9aa89e10ce184e24d31e8878da1f2d2a8987fbc32"} Jun 03 15:05:48.088426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.088067 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"06352ba8ec67a872dd466719e96f245d82515fb63ede0881ac3b98ef50486685"} Jun 03 15:05:48.088426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.088075 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2838c822-6b3e-43be-9726-9cb2ba952300","Type":"ContainerStarted","Data":"df4db4abcad52cdeae5094486e3e75c9acd37ac26fbaba744adf3d5ba1ac1919"} Jun 03 15:05:48.118528 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:05:48.118485 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.118473401 podStartE2EDuration="2.118473401s" podCreationTimestamp="2026-06-03 15:05:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:05:48.116354631 +0000 UTC m=+128.249643531" watchObservedRunningTime="2026-06-03 15:05:48.118473401 +0000 UTC m=+128.251762302" Jun 03 15:06:08.393311 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.393280 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xs78h"] Jun 03 15:06:08.395158 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.395123 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.398818 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.398800 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:06:08.407249 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.407222 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xs78h"] Jun 03 15:06:08.499414 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.499388 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-kubelet-config\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.499536 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.499446 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/835708ec-deaa-4306-a775-0fad9a810c7a-original-pull-secret\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.499536 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.499490 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-dbus\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.599835 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.599806 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-dbus\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.599968 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.599844 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-kubelet-config\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.599968 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.599888 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/835708ec-deaa-4306-a775-0fad9a810c7a-original-pull-secret\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.600037 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.599992 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-kubelet-config\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.600037 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.600005 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/835708ec-deaa-4306-a775-0fad9a810c7a-dbus\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.602109 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.602089 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/835708ec-deaa-4306-a775-0fad9a810c7a-original-pull-secret\") pod \"global-pull-secret-syncer-xs78h\" (UID: \"835708ec-deaa-4306-a775-0fad9a810c7a\") " pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.704414 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.704392 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xs78h" Jun 03 15:06:08.839115 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:08.839093 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xs78h"] Jun 03 15:06:08.840825 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:06:08.840796 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835708ec_deaa_4306_a775_0fad9a810c7a.slice/crio-95bbc6a25b2c335be22b09a2dc5e5efbf8300396fd8710766ee6a80ddc74bca8 WatchSource:0}: Error finding container 95bbc6a25b2c335be22b09a2dc5e5efbf8300396fd8710766ee6a80ddc74bca8: Status 404 returned error can't find the container with id 95bbc6a25b2c335be22b09a2dc5e5efbf8300396fd8710766ee6a80ddc74bca8 Jun 03 15:06:09.146606 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:09.146524 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xs78h" event={"ID":"835708ec-deaa-4306-a775-0fad9a810c7a","Type":"ContainerStarted","Data":"95bbc6a25b2c335be22b09a2dc5e5efbf8300396fd8710766ee6a80ddc74bca8"} Jun 03 15:06:14.160436 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:14.160404 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xs78h" event={"ID":"835708ec-deaa-4306-a775-0fad9a810c7a","Type":"ContainerStarted","Data":"65de57116fdcfb897b7ea8c648888439a305691a3fbc6979b3e006b73d00d5d6"} Jun 03 15:06:14.180736 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:14.180688 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xs78h" podStartSLOduration=0.993074339 podStartE2EDuration="6.180673786s" podCreationTimestamp="2026-06-03 15:06:08 +0000 UTC" firstStartedPulling="2026-06-03 15:06:08.842582446 +0000 UTC m=+148.975871328" lastFinishedPulling="2026-06-03 15:06:14.03018189 +0000 UTC m=+154.163470775" observedRunningTime="2026-06-03 15:06:14.180278835 +0000 UTC m=+154.313567759" watchObservedRunningTime="2026-06-03 15:06:14.180673786 +0000 UTC m=+154.313962687" Jun 03 15:06:48.916735 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.916698 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7"] Jun 03 15:06:48.919861 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.919842 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:48.927383 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.927360 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:06:48.927489 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.927388 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:06:48.928413 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.928395 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:06:48.938789 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.938770 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7"] Jun 03 15:06:48.990754 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.990725 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:48.990754 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.990755 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhmrw\" (UniqueName: \"kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:48.990915 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:48.990776 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.091580 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.091549 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.091733 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.091584 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhmrw\" (UniqueName: \"kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.091733 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.091617 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.092002 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.091981 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.092002 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.091992 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.101638 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.101610 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhmrw\" (UniqueName: \"kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.228963 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.228932 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:06:49.355168 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:49.354986 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7"] Jun 03 15:06:49.357688 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:06:49.357627 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986c4aae_04ca_4136_95a6_d1e5fcbd75bd.slice/crio-76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420 WatchSource:0}: Error finding container 76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420: Status 404 returned error can't find the container with id 76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420 Jun 03 15:06:50.257520 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:50.257483 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" event={"ID":"986c4aae-04ca-4136-95a6-d1e5fcbd75bd","Type":"ContainerStarted","Data":"76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420"} Jun 03 15:06:59.283267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:59.283227 2527 generic.go:358] "Generic (PLEG): container finished" podID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerID="b70a2256e0eae2dfe249e83072430499f0d0fbd17ae8a317a2cfb04153d83181" exitCode=0 Jun 03 15:06:59.283628 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:06:59.283308 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" event={"ID":"986c4aae-04ca-4136-95a6-d1e5fcbd75bd","Type":"ContainerDied","Data":"b70a2256e0eae2dfe249e83072430499f0d0fbd17ae8a317a2cfb04153d83181"} Jun 03 15:07:06.303982 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:06.303948 2527 generic.go:358] "Generic (PLEG): container finished" podID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerID="e729a363c56ffa4454d28d7a01e10ae4c702662054f36d70889971c189f31cab" exitCode=0 Jun 03 15:07:06.304365 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:06.304017 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" event={"ID":"986c4aae-04ca-4136-95a6-d1e5fcbd75bd","Type":"ContainerDied","Data":"e729a363c56ffa4454d28d7a01e10ae4c702662054f36d70889971c189f31cab"} Jun 03 15:07:15.333519 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:15.333473 2527 generic.go:358] "Generic (PLEG): container finished" podID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerID="edc327b26f6337c1651f6b063b2a51379111714b9e3c858dc7dbf9760dd62dbd" exitCode=0 Jun 03 15:07:15.333988 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:15.333561 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" event={"ID":"986c4aae-04ca-4136-95a6-d1e5fcbd75bd","Type":"ContainerDied","Data":"edc327b26f6337c1651f6b063b2a51379111714b9e3c858dc7dbf9760dd62dbd"} Jun 03 15:07:16.467435 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.467408 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:07:16.522910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.522859 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhmrw\" (UniqueName: \"kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw\") pod \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " Jun 03 15:07:16.522910 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.522905 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle\") pod \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " Jun 03 15:07:16.523183 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.522964 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util\") pod \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\" (UID: \"986c4aae-04ca-4136-95a6-d1e5fcbd75bd\") " Jun 03 15:07:16.523887 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.523848 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle" (OuterVolumeSpecName: "bundle") pod "986c4aae-04ca-4136-95a6-d1e5fcbd75bd" (UID: "986c4aae-04ca-4136-95a6-d1e5fcbd75bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:16.525291 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.525255 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw" (OuterVolumeSpecName: "kube-api-access-bhmrw") pod "986c4aae-04ca-4136-95a6-d1e5fcbd75bd" (UID: "986c4aae-04ca-4136-95a6-d1e5fcbd75bd"). InnerVolumeSpecName "kube-api-access-bhmrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:07:16.527296 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.527272 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util" (OuterVolumeSpecName: "util") pod "986c4aae-04ca-4136-95a6-d1e5fcbd75bd" (UID: "986c4aae-04ca-4136-95a6-d1e5fcbd75bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:16.624550 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.624457 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhmrw\" (UniqueName: \"kubernetes.io/projected/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-kube-api-access-bhmrw\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:16.624550 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.624494 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:16.624550 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:16.624504 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/986c4aae-04ca-4136-95a6-d1e5fcbd75bd-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:17.341094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:17.341049 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" event={"ID":"986c4aae-04ca-4136-95a6-d1e5fcbd75bd","Type":"ContainerDied","Data":"76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420"} Jun 03 15:07:17.341094 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:17.341087 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76fc91a69a41750abcf5fe3f3c756aa736a397587d973ca2e32739601a252420" Jun 03 15:07:17.341289 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:17.341121 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtqbs7" Jun 03 15:07:22.099735 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099692 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k"] Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099960 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="util" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099970 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="util" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099980 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="extract" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099985 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="extract" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.099999 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="pull" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.100004 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="pull" Jun 03 15:07:22.100166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.100067 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="986c4aae-04ca-4136-95a6-d1e5fcbd75bd" containerName="extract" Jun 03 15:07:22.104897 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.104867 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.108117 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.108096 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:07:22.108268 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.108183 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 15:07:22.108494 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.108478 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-52k6d\"" Jun 03 15:07:22.120853 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.120815 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k"] Jun 03 15:07:22.170003 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.169956 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6n64\" (UniqueName: \"kubernetes.io/projected/87f35dd9-789c-4c39-9776-a4d2df382162-kube-api-access-t6n64\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.170227 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.170051 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87f35dd9-789c-4c39-9776-a4d2df382162-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.270619 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.270567 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87f35dd9-789c-4c39-9776-a4d2df382162-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.270796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.270678 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6n64\" (UniqueName: \"kubernetes.io/projected/87f35dd9-789c-4c39-9776-a4d2df382162-kube-api-access-t6n64\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.271029 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.271008 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87f35dd9-789c-4c39-9776-a4d2df382162-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.281473 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.281442 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6n64\" (UniqueName: \"kubernetes.io/projected/87f35dd9-789c-4c39-9776-a4d2df382162-kube-api-access-t6n64\") pod \"cert-manager-operator-controller-manager-54b9655956-nxj9k\" (UID: \"87f35dd9-789c-4c39-9776-a4d2df382162\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.414532 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.414416 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" Jun 03 15:07:22.562446 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:22.562408 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k"] Jun 03 15:07:22.566415 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:22.566379 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f35dd9_789c_4c39_9776_a4d2df382162.slice/crio-d54a36b3b48129af84eb5853ec6c700366a3381d08d3ec80bd5dfa25825a62ae WatchSource:0}: Error finding container d54a36b3b48129af84eb5853ec6c700366a3381d08d3ec80bd5dfa25825a62ae: Status 404 returned error can't find the container with id d54a36b3b48129af84eb5853ec6c700366a3381d08d3ec80bd5dfa25825a62ae Jun 03 15:07:23.358713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:23.358673 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" event={"ID":"87f35dd9-789c-4c39-9776-a4d2df382162","Type":"ContainerStarted","Data":"d54a36b3b48129af84eb5853ec6c700366a3381d08d3ec80bd5dfa25825a62ae"} Jun 03 15:07:25.366506 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:25.366470 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" event={"ID":"87f35dd9-789c-4c39-9776-a4d2df382162","Type":"ContainerStarted","Data":"4d3aff5ffc406a2facc79edc07d7e4ac9da1d119a2ad275ec6036f667046afcd"} Jun 03 15:07:25.391945 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:25.391875 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-nxj9k" podStartSLOduration=1.129007484 podStartE2EDuration="3.391852571s" podCreationTimestamp="2026-06-03 15:07:22 +0000 UTC" firstStartedPulling="2026-06-03 15:07:22.571733643 +0000 UTC m=+222.705022537" lastFinishedPulling="2026-06-03 15:07:24.834578741 +0000 UTC m=+224.967867624" observedRunningTime="2026-06-03 15:07:25.389574736 +0000 UTC m=+225.522863637" watchObservedRunningTime="2026-06-03 15:07:25.391852571 +0000 UTC m=+225.525141473" Jun 03 15:07:26.596147 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.596096 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n"] Jun 03 15:07:26.599076 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.599049 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.602659 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.602623 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:07:26.602834 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.602726 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:07:26.604328 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.604308 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:07:26.610954 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.610924 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n"] Jun 03 15:07:26.710622 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.710573 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.710796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.710632 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdrtd\" (UniqueName: \"kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.710796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.710727 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.811592 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.811533 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.811592 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.811589 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdrtd\" (UniqueName: \"kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.811825 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.811627 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.812049 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.812023 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.812086 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.812026 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.828539 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.828504 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdrtd\" (UniqueName: \"kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:26.908598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:26.908515 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:27.060807 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.060774 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n"] Jun 03 15:07:27.063448 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:27.063419 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb1d704_e71c_4259_b559_721225ec8f38.slice/crio-c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb WatchSource:0}: Error finding container c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb: Status 404 returned error can't find the container with id c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb Jun 03 15:07:27.087623 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.087585 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-rn2wr"] Jun 03 15:07:27.090381 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.090360 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.094172 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.094127 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8th56\"" Jun 03 15:07:27.094375 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.094360 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 15:07:27.094763 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.094737 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 15:07:27.104913 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.104882 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-rn2wr"] Jun 03 15:07:27.114392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.114355 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zv98\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-kube-api-access-2zv98\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.114392 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.114396 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.215030 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.214985 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zv98\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-kube-api-access-2zv98\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.215030 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.215029 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.228594 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.228554 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.228740 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.228627 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zv98\" (UniqueName: \"kubernetes.io/projected/eae8b4f6-580b-46de-99cc-d8c3a6630af9-kube-api-access-2zv98\") pod \"cert-manager-webhook-587ccfb98-rn2wr\" (UID: \"eae8b4f6-580b-46de-99cc-d8c3a6630af9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.374437 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.374391 2527 generic.go:358] "Generic (PLEG): container finished" podID="cbb1d704-e71c-4259-b559-721225ec8f38" containerID="b5b997b2d828b01ada762ad78eb41570067d87d10bc8d6c292c5a8058b9ea9c2" exitCode=0 Jun 03 15:07:27.374437 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.374436 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" event={"ID":"cbb1d704-e71c-4259-b559-721225ec8f38","Type":"ContainerDied","Data":"b5b997b2d828b01ada762ad78eb41570067d87d10bc8d6c292c5a8058b9ea9c2"} Jun 03 15:07:27.374653 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.374462 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" event={"ID":"cbb1d704-e71c-4259-b559-721225ec8f38","Type":"ContainerStarted","Data":"c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb"} Jun 03 15:07:27.416487 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.416437 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:27.560586 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:27.560548 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-rn2wr"] Jun 03 15:07:27.563973 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:27.563936 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae8b4f6_580b_46de_99cc_d8c3a6630af9.slice/crio-6ec8c426f4023df22f0976ec85a9e43595df649ff509fd30cdc43f95e3f4b531 WatchSource:0}: Error finding container 6ec8c426f4023df22f0976ec85a9e43595df649ff509fd30cdc43f95e3f4b531: Status 404 returned error can't find the container with id 6ec8c426f4023df22f0976ec85a9e43595df649ff509fd30cdc43f95e3f4b531 Jun 03 15:07:28.379128 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:28.379081 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" event={"ID":"eae8b4f6-580b-46de-99cc-d8c3a6630af9","Type":"ContainerStarted","Data":"6ec8c426f4023df22f0976ec85a9e43595df649ff509fd30cdc43f95e3f4b531"} Jun 03 15:07:29.438572 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.438528 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vxl9r"] Jun 03 15:07:29.446816 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.446756 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.449620 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.449587 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vxl9r"] Jun 03 15:07:29.450436 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.450411 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gnl59\"" Jun 03 15:07:29.537302 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.537268 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lds\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-kube-api-access-d6lds\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.537443 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.537321 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.638774 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.638726 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lds\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-kube-api-access-d6lds\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.638948 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.638795 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.648004 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.647977 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.648120 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.648098 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lds\" (UniqueName: \"kubernetes.io/projected/deaf2647-8248-4645-b08f-70bc2445b317-kube-api-access-d6lds\") pod \"cert-manager-cainjector-68b757865b-vxl9r\" (UID: \"deaf2647-8248-4645-b08f-70bc2445b317\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.757994 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.757953 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" Jun 03 15:07:29.893938 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:29.893910 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vxl9r"] Jun 03 15:07:29.896270 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:29.896245 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeaf2647_8248_4645_b08f_70bc2445b317.slice/crio-1d6cec36f85ea20ea4db67a755e50c1b4d3ca35eef33f434f86c304f2333810e WatchSource:0}: Error finding container 1d6cec36f85ea20ea4db67a755e50c1b4d3ca35eef33f434f86c304f2333810e: Status 404 returned error can't find the container with id 1d6cec36f85ea20ea4db67a755e50c1b4d3ca35eef33f434f86c304f2333810e Jun 03 15:07:30.388632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:30.388592 2527 generic.go:358] "Generic (PLEG): container finished" podID="cbb1d704-e71c-4259-b559-721225ec8f38" containerID="81a8f2f8b79c4fac376a0ee3a278396b53d00db8c558205bde21cdbaed79e433" exitCode=0 Jun 03 15:07:30.388847 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:30.388674 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" event={"ID":"cbb1d704-e71c-4259-b559-721225ec8f38","Type":"ContainerDied","Data":"81a8f2f8b79c4fac376a0ee3a278396b53d00db8c558205bde21cdbaed79e433"} Jun 03 15:07:30.389869 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:30.389839 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" event={"ID":"deaf2647-8248-4645-b08f-70bc2445b317","Type":"ContainerStarted","Data":"1d6cec36f85ea20ea4db67a755e50c1b4d3ca35eef33f434f86c304f2333810e"} Jun 03 15:07:31.396872 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:31.396749 2527 generic.go:358] "Generic (PLEG): container finished" podID="cbb1d704-e71c-4259-b559-721225ec8f38" containerID="fd7732e4788e1c7dc2fbdb696cb6c4e114f24c9840cd5699c8964c960e49a5f5" exitCode=0 Jun 03 15:07:31.396872 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:31.396809 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" event={"ID":"cbb1d704-e71c-4259-b559-721225ec8f38","Type":"ContainerDied","Data":"fd7732e4788e1c7dc2fbdb696cb6c4e114f24c9840cd5699c8964c960e49a5f5"} Jun 03 15:07:32.552923 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.552899 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:32.666254 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.666220 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle\") pod \"cbb1d704-e71c-4259-b559-721225ec8f38\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " Jun 03 15:07:32.666396 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.666283 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util\") pod \"cbb1d704-e71c-4259-b559-721225ec8f38\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " Jun 03 15:07:32.666396 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.666316 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdrtd\" (UniqueName: \"kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd\") pod \"cbb1d704-e71c-4259-b559-721225ec8f38\" (UID: \"cbb1d704-e71c-4259-b559-721225ec8f38\") " Jun 03 15:07:32.666840 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.666623 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle" (OuterVolumeSpecName: "bundle") pod "cbb1d704-e71c-4259-b559-721225ec8f38" (UID: "cbb1d704-e71c-4259-b559-721225ec8f38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:32.666840 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.666808 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:32.668706 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.668682 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd" (OuterVolumeSpecName: "kube-api-access-qdrtd") pod "cbb1d704-e71c-4259-b559-721225ec8f38" (UID: "cbb1d704-e71c-4259-b559-721225ec8f38"). InnerVolumeSpecName "kube-api-access-qdrtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:07:32.768596 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.768324 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdrtd\" (UniqueName: \"kubernetes.io/projected/cbb1d704-e71c-4259-b559-721225ec8f38-kube-api-access-qdrtd\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:32.930121 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.930003 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util" (OuterVolumeSpecName: "util") pod "cbb1d704-e71c-4259-b559-721225ec8f38" (UID: "cbb1d704-e71c-4259-b559-721225ec8f38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:32.970546 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:32.970501 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbb1d704-e71c-4259-b559-721225ec8f38-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:33.406067 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.406021 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" event={"ID":"cbb1d704-e71c-4259-b559-721225ec8f38","Type":"ContainerDied","Data":"c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb"} Jun 03 15:07:33.406067 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.406063 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn6q6n" Jun 03 15:07:33.406067 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.406068 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1adf3242e88d485550e5227de7f537331c99020cdb5afdfa5ceaffd307c7cbb" Jun 03 15:07:33.407522 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.407489 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" event={"ID":"deaf2647-8248-4645-b08f-70bc2445b317","Type":"ContainerStarted","Data":"38d20914bfeac4751f2f300ac90d0679767dc29809d4d15600a8491b9b288844"} Jun 03 15:07:33.408837 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.408809 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" event={"ID":"eae8b4f6-580b-46de-99cc-d8c3a6630af9","Type":"ContainerStarted","Data":"b35cd3876f69830c9542d7a6fad3bf1c44b2688d4350306c7e0528352e3b2b9e"} Jun 03 15:07:33.408929 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.408890 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:33.427253 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.427199 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-vxl9r" podStartSLOduration=1.673341951 podStartE2EDuration="4.427185231s" podCreationTimestamp="2026-06-03 15:07:29 +0000 UTC" firstStartedPulling="2026-06-03 15:07:29.898162056 +0000 UTC m=+230.031450934" lastFinishedPulling="2026-06-03 15:07:32.652005335 +0000 UTC m=+232.785294214" observedRunningTime="2026-06-03 15:07:33.425866564 +0000 UTC m=+233.559155488" watchObservedRunningTime="2026-06-03 15:07:33.427185231 +0000 UTC m=+233.560474131" Jun 03 15:07:33.447818 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:33.447751 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" podStartSLOduration=1.367914306 podStartE2EDuration="6.447726944s" podCreationTimestamp="2026-06-03 15:07:27 +0000 UTC" firstStartedPulling="2026-06-03 15:07:27.565924008 +0000 UTC m=+227.699212887" lastFinishedPulling="2026-06-03 15:07:32.645736644 +0000 UTC m=+232.779025525" observedRunningTime="2026-06-03 15:07:33.446113199 +0000 UTC m=+233.579402115" watchObservedRunningTime="2026-06-03 15:07:33.447726944 +0000 UTC m=+233.581015847" Jun 03 15:07:39.414267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:39.414230 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-rn2wr" Jun 03 15:07:46.388977 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.388929 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-j94tj"] Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389393 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="pull" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389413 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="pull" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389429 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="extract" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389437 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="extract" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389447 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="util" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389457 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="util" Jun 03 15:07:46.389609 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.389540 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbb1d704-e71c-4259-b559-721225ec8f38" containerName="extract" Jun 03 15:07:46.393146 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.393105 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.397150 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.397111 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w5b8f\"" Jun 03 15:07:46.402937 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.402911 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-j94tj"] Jun 03 15:07:46.433945 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.433907 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5"] Jun 03 15:07:46.436470 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.436450 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.439485 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.439462 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:07:46.439809 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.439791 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:07:46.439960 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.439940 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:07:46.446424 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.446399 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5"] Jun 03 15:07:46.494312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.494260 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5m4\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-kube-api-access-7f5m4\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.494535 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.494402 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-bound-sa-token\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.595900 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.595846 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.595900 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.595900 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-bound-sa-token\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.596209 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.596082 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5m4\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-kube-api-access-7f5m4\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.596209 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.596123 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.596306 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.596265 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2m46\" (UniqueName: \"kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.606245 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.606218 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-bound-sa-token\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.606454 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.606431 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5m4\" (UniqueName: \"kubernetes.io/projected/08f43918-65cd-4b21-a55e-00ad8ea5542f-kube-api-access-7f5m4\") pod \"cert-manager-79c8d999ff-j94tj\" (UID: \"08f43918-65cd-4b21-a55e-00ad8ea5542f\") " pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.697025 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.696985 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.697256 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.697083 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2m46\" (UniqueName: \"kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.697256 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.697124 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.697424 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.697401 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.697498 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.697475 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.702944 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.702914 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-j94tj" Jun 03 15:07:46.706412 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.706378 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2m46\" (UniqueName: \"kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.746026 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.745985 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:46.867270 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.864856 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-j94tj"] Jun 03 15:07:46.873098 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:46.873032 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08f43918_65cd_4b21_a55e_00ad8ea5542f.slice/crio-d1e37a8aa87b96858fe3c0a427a76c500452e9c220edc009aa3675438624a2e8 WatchSource:0}: Error finding container d1e37a8aa87b96858fe3c0a427a76c500452e9c220edc009aa3675438624a2e8: Status 404 returned error can't find the container with id d1e37a8aa87b96858fe3c0a427a76c500452e9c220edc009aa3675438624a2e8 Jun 03 15:07:46.919530 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:46.918543 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5"] Jun 03 15:07:46.924158 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:07:46.924099 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a83d7c4_1255_4f61_a166_154c2eae8681.slice/crio-330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f WatchSource:0}: Error finding container 330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f: Status 404 returned error can't find the container with id 330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f Jun 03 15:07:47.458246 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.458204 2527 generic.go:358] "Generic (PLEG): container finished" podID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerID="6f699d17a0e74d29f8dc7db8b683f2d89615990600acb8cbf3fa64c0de100784" exitCode=0 Jun 03 15:07:47.458730 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.458301 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" event={"ID":"8a83d7c4-1255-4f61-a166-154c2eae8681","Type":"ContainerDied","Data":"6f699d17a0e74d29f8dc7db8b683f2d89615990600acb8cbf3fa64c0de100784"} Jun 03 15:07:47.458730 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.458346 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" event={"ID":"8a83d7c4-1255-4f61-a166-154c2eae8681","Type":"ContainerStarted","Data":"330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f"} Jun 03 15:07:47.459828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.459800 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-j94tj" event={"ID":"08f43918-65cd-4b21-a55e-00ad8ea5542f","Type":"ContainerStarted","Data":"da1c3d39ad6201d42dec1136172442765500bda9da42cd0769d8118829778bd7"} Jun 03 15:07:47.459916 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.459843 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-j94tj" event={"ID":"08f43918-65cd-4b21-a55e-00ad8ea5542f","Type":"ContainerStarted","Data":"d1e37a8aa87b96858fe3c0a427a76c500452e9c220edc009aa3675438624a2e8"} Jun 03 15:07:47.503199 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:47.503115 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-j94tj" podStartSLOduration=1.5030959689999999 podStartE2EDuration="1.503095969s" podCreationTimestamp="2026-06-03 15:07:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:07:47.502121342 +0000 UTC m=+247.635410258" watchObservedRunningTime="2026-06-03 15:07:47.503095969 +0000 UTC m=+247.636384869" Jun 03 15:07:48.465490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:48.465451 2527 generic.go:358] "Generic (PLEG): container finished" podID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerID="6ee91db74544d6f6fe3c069a855be5ee5d05aac18ac648346252ac8229416dbe" exitCode=0 Jun 03 15:07:48.465881 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:48.465541 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" event={"ID":"8a83d7c4-1255-4f61-a166-154c2eae8681","Type":"ContainerDied","Data":"6ee91db74544d6f6fe3c069a855be5ee5d05aac18ac648346252ac8229416dbe"} Jun 03 15:07:49.471334 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:49.471293 2527 generic.go:358] "Generic (PLEG): container finished" podID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerID="8c6d929c430d212392a1249ca2fe3fa97daedd14a2654c1a7660a5225b8c26ff" exitCode=0 Jun 03 15:07:49.471723 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:49.471354 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" event={"ID":"8a83d7c4-1255-4f61-a166-154c2eae8681","Type":"ContainerDied","Data":"8c6d929c430d212392a1249ca2fe3fa97daedd14a2654c1a7660a5225b8c26ff"} Jun 03 15:07:50.606490 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.606463 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:50.733658 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.733542 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2m46\" (UniqueName: \"kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46\") pod \"8a83d7c4-1255-4f61-a166-154c2eae8681\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " Jun 03 15:07:50.733658 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.733608 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util\") pod \"8a83d7c4-1255-4f61-a166-154c2eae8681\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " Jun 03 15:07:50.733859 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.733683 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle\") pod \"8a83d7c4-1255-4f61-a166-154c2eae8681\" (UID: \"8a83d7c4-1255-4f61-a166-154c2eae8681\") " Jun 03 15:07:50.734580 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.734531 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle" (OuterVolumeSpecName: "bundle") pod "8a83d7c4-1255-4f61-a166-154c2eae8681" (UID: "8a83d7c4-1255-4f61-a166-154c2eae8681"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:50.735684 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.735661 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46" (OuterVolumeSpecName: "kube-api-access-h2m46") pod "8a83d7c4-1255-4f61-a166-154c2eae8681" (UID: "8a83d7c4-1255-4f61-a166-154c2eae8681"). InnerVolumeSpecName "kube-api-access-h2m46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:07:50.742402 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.742313 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util" (OuterVolumeSpecName: "util") pod "8a83d7c4-1255-4f61-a166-154c2eae8681" (UID: "8a83d7c4-1255-4f61-a166-154c2eae8681"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:07:50.834504 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.834456 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2m46\" (UniqueName: \"kubernetes.io/projected/8a83d7c4-1255-4f61-a166-154c2eae8681-kube-api-access-h2m46\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:50.834504 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.834492 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:50.834504 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:50.834502 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a83d7c4-1255-4f61-a166-154c2eae8681-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:07:51.480244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:51.480205 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" event={"ID":"8a83d7c4-1255-4f61-a166-154c2eae8681","Type":"ContainerDied","Data":"330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f"} Jun 03 15:07:51.480244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:51.480239 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="330b6f3057450793c04ad2160609d3ce30c2dd125029394c85649ce65c1a7f6f" Jun 03 15:07:51.480244 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:51.480248 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwk6m5" Jun 03 15:07:59.705153 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705039 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs"] Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705453 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="pull" Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705468 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="pull" Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705486 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="extract" Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705492 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="extract" Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705505 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="util" Jun 03 15:07:59.705554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705510 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="util" Jun 03 15:07:59.705749 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.705560 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a83d7c4-1255-4f61-a166-154c2eae8681" containerName="extract" Jun 03 15:07:59.707561 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.707543 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.711713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.711675 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:07:59.711859 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.711675 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lq6j4\"" Jun 03 15:07:59.712248 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.712225 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:07:59.712248 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.712246 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:07:59.712390 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.712229 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:07:59.735201 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.735157 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs"] Jun 03 15:07:59.807640 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.807594 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.807841 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.807664 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.807841 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.807694 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.807841 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.807741 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr8rd\" (UniqueName: \"kubernetes.io/projected/dfeb9898-3fd8-40a3-aac0-d7b638264c69-kube-api-access-mr8rd\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.807841 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.807770 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.908631 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.908581 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.908804 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.908678 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.908804 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.908717 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.908804 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.908734 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.908804 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.908781 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr8rd\" (UniqueName: \"kubernetes.io/projected/dfeb9898-3fd8-40a3-aac0-d7b638264c69-kube-api-access-mr8rd\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.909124 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.909100 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.911323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.911288 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfeb9898-3fd8-40a3-aac0-d7b638264c69-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.911589 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.911567 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.911637 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.911574 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfeb9898-3fd8-40a3-aac0-d7b638264c69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:07:59.921728 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:07:59.921701 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr8rd\" (UniqueName: \"kubernetes.io/projected/dfeb9898-3fd8-40a3-aac0-d7b638264c69-kube-api-access-mr8rd\") pod \"opendatahub-operator-controller-manager-5678f4b79b-98tvs\" (UID: \"dfeb9898-3fd8-40a3-aac0-d7b638264c69\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:08:00.018207 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:00.018087 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:08:00.178420 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:00.178384 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs"] Jun 03 15:08:00.182466 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:00.182434 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfeb9898_3fd8_40a3_aac0_d7b638264c69.slice/crio-b426f9183869741e740bddf16fa190e02e4545faa8695abe772c9875d42bb47f WatchSource:0}: Error finding container b426f9183869741e740bddf16fa190e02e4545faa8695abe772c9875d42bb47f: Status 404 returned error can't find the container with id b426f9183869741e740bddf16fa190e02e4545faa8695abe772c9875d42bb47f Jun 03 15:08:00.513607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:00.513564 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" event={"ID":"dfeb9898-3fd8-40a3-aac0-d7b638264c69","Type":"ContainerStarted","Data":"b426f9183869741e740bddf16fa190e02e4545faa8695abe772c9875d42bb47f"} Jun 03 15:08:03.527895 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:03.527807 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" event={"ID":"dfeb9898-3fd8-40a3-aac0-d7b638264c69","Type":"ContainerStarted","Data":"68a26220110e26241e75467146366deeea90c6976339946a92ec32461d0171d7"} Jun 03 15:08:04.533808 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:04.533767 2527 generic.go:358] "Generic (PLEG): container finished" podID="dfeb9898-3fd8-40a3-aac0-d7b638264c69" containerID="68a26220110e26241e75467146366deeea90c6976339946a92ec32461d0171d7" exitCode=0 Jun 03 15:08:04.534252 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:04.533853 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" event={"ID":"dfeb9898-3fd8-40a3-aac0-d7b638264c69","Type":"ContainerDied","Data":"68a26220110e26241e75467146366deeea90c6976339946a92ec32461d0171d7"} Jun 03 15:08:05.541005 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:05.540961 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" event={"ID":"dfeb9898-3fd8-40a3-aac0-d7b638264c69","Type":"ContainerStarted","Data":"52563df9b172b54b62d7a6240fb6cf6f3925d95ce99295d3cbfe6db84d17f33a"} Jun 03 15:08:05.541547 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:05.541100 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:08:05.594712 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:05.594654 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" podStartSLOduration=1.9373822870000001 podStartE2EDuration="6.59463673s" podCreationTimestamp="2026-06-03 15:07:59 +0000 UTC" firstStartedPulling="2026-06-03 15:08:00.184128391 +0000 UTC m=+260.317417270" lastFinishedPulling="2026-06-03 15:08:04.84138282 +0000 UTC m=+264.974671713" observedRunningTime="2026-06-03 15:08:05.593892108 +0000 UTC m=+265.727181009" watchObservedRunningTime="2026-06-03 15:08:05.59463673 +0000 UTC m=+265.727925680" Jun 03 15:08:16.546719 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:16.546682 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-98tvs" Jun 03 15:08:19.647489 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.647450 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-msjbs"] Jun 03 15:08:19.658629 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.658598 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.663557 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.663525 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:08:19.663731 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.663525 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 15:08:19.663731 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.663525 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ltc8w\"" Jun 03 15:08:19.663938 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.663920 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 15:08:19.665118 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.665100 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:08:19.675109 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.675059 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-msjbs"] Jun 03 15:08:19.788546 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.788496 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjkd\" (UniqueName: \"kubernetes.io/projected/56deb6c1-002b-425d-8f6f-eb16801aeea3-kube-api-access-jvjkd\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.788546 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.788549 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56deb6c1-002b-425d-8f6f-eb16801aeea3-tls-certs\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.788785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.788659 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56deb6c1-002b-425d-8f6f-eb16801aeea3-tmp\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.809759 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.809712 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg"] Jun 03 15:08:19.812323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.812296 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.817873 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.817841 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:08:19.818044 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.817937 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:08:19.818316 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.818296 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:08:19.829533 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.829494 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg"] Jun 03 15:08:19.889449 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889410 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvhc\" (UniqueName: \"kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.889632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889468 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjkd\" (UniqueName: \"kubernetes.io/projected/56deb6c1-002b-425d-8f6f-eb16801aeea3-kube-api-access-jvjkd\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.889632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889498 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56deb6c1-002b-425d-8f6f-eb16801aeea3-tls-certs\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.889632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889539 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56deb6c1-002b-425d-8f6f-eb16801aeea3-tmp\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.889632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889573 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.889632 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.889598 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.891886 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.891851 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56deb6c1-002b-425d-8f6f-eb16801aeea3-tmp\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.892171 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.892152 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56deb6c1-002b-425d-8f6f-eb16801aeea3-tls-certs\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.920077 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.919988 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjkd\" (UniqueName: \"kubernetes.io/projected/56deb6c1-002b-425d-8f6f-eb16801aeea3-kube-api-access-jvjkd\") pod \"kube-auth-proxy-6d85c64844-msjbs\" (UID: \"56deb6c1-002b-425d-8f6f-eb16801aeea3\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.932616 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.932578 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvbks"] Jun 03 15:08:19.935667 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.935642 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:19.938987 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.938952 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tn54l\"" Jun 03 15:08:19.939144 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.938952 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 15:08:19.953713 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.953678 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvbks"] Jun 03 15:08:19.970378 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.970340 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" Jun 03 15:08:19.991024 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.990990 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvhc\" (UniqueName: \"kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.991230 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991044 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkf94\" (UniqueName: \"kubernetes.io/projected/9d28aad4-3db2-46b7-a48e-f9d085e0661a-kube-api-access-jkf94\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:19.991230 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991088 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:19.991230 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991119 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.991230 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991153 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.991587 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991566 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:19.991587 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:19.991579 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:20.019828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.019798 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvhc\" (UniqueName: \"kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:20.092574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.092538 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkf94\" (UniqueName: \"kubernetes.io/projected/9d28aad4-3db2-46b7-a48e-f9d085e0661a-kube-api-access-jkf94\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.092765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.092600 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.092765 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:08:20.092725 2527 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 15:08:20.092936 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:08:20.092798 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert podName:9d28aad4-3db2-46b7-a48e-f9d085e0661a nodeName:}" failed. No retries permitted until 2026-06-03 15:08:20.592776697 +0000 UTC m=+280.726065583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert") pod "odh-model-controller-76588b95-lvbks" (UID: "9d28aad4-3db2-46b7-a48e-f9d085e0661a") : secret "odh-model-controller-webhook-cert" not found Jun 03 15:08:20.115489 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.115448 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkf94\" (UniqueName: \"kubernetes.io/projected/9d28aad4-3db2-46b7-a48e-f9d085e0661a-kube-api-access-jkf94\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.123249 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.123207 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:20.213530 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.213495 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-msjbs"] Jun 03 15:08:20.218355 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:20.218222 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56deb6c1_002b_425d_8f6f_eb16801aeea3.slice/crio-1126c3282a1049e4f0176fe32ce244e878489c86ceb6eb1ed628b7931916cf65 WatchSource:0}: Error finding container 1126c3282a1049e4f0176fe32ce244e878489c86ceb6eb1ed628b7931916cf65: Status 404 returned error can't find the container with id 1126c3282a1049e4f0176fe32ce244e878489c86ceb6eb1ed628b7931916cf65 Jun 03 15:08:20.337083 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.337048 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg"] Jun 03 15:08:20.338295 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:20.338262 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eff9c5e_bf33_49d5_9793_15f9975f0217.slice/crio-433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0 WatchSource:0}: Error finding container 433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0: Status 404 returned error can't find the container with id 433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0 Jun 03 15:08:20.595412 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.595366 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" event={"ID":"56deb6c1-002b-425d-8f6f-eb16801aeea3","Type":"ContainerStarted","Data":"1126c3282a1049e4f0176fe32ce244e878489c86ceb6eb1ed628b7931916cf65"} Jun 03 15:08:20.596721 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.596691 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.596856 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.596721 2527 generic.go:358] "Generic (PLEG): container finished" podID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerID="c35127db311c9d0f2788f037b64bdef6de98621e8c512a4c4f2de7ebe8320377" exitCode=0 Jun 03 15:08:20.596856 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.596757 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" event={"ID":"0eff9c5e-bf33-49d5-9793-15f9975f0217","Type":"ContainerDied","Data":"c35127db311c9d0f2788f037b64bdef6de98621e8c512a4c4f2de7ebe8320377"} Jun 03 15:08:20.596856 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.596778 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" event={"ID":"0eff9c5e-bf33-49d5-9793-15f9975f0217","Type":"ContainerStarted","Data":"433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0"} Jun 03 15:08:20.599315 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.599291 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d28aad4-3db2-46b7-a48e-f9d085e0661a-cert\") pod \"odh-model-controller-76588b95-lvbks\" (UID: \"9d28aad4-3db2-46b7-a48e-f9d085e0661a\") " pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.848503 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.848399 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:20.997086 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.997013 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lvbks"] Jun 03 15:08:20.999812 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:20.999770 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p8qb8"] Jun 03 15:08:21.000071 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:21.000036 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d28aad4_3db2_46b7_a48e_f9d085e0661a.slice/crio-83b439e92635e7a871551216841342501f789109eaf8c304b88e548f197ea7e7 WatchSource:0}: Error finding container 83b439e92635e7a871551216841342501f789109eaf8c304b88e548f197ea7e7: Status 404 returned error can't find the container with id 83b439e92635e7a871551216841342501f789109eaf8c304b88e548f197ea7e7 Jun 03 15:08:21.003462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.003435 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.006727 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.006698 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 15:08:21.013702 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.013672 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p8qb8"] Jun 03 15:08:21.102883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.102779 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcht\" (UniqueName: \"kubernetes.io/projected/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-kube-api-access-9pcht\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.102883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.102867 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.204411 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.204368 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcht\" (UniqueName: \"kubernetes.io/projected/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-kube-api-access-9pcht\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.204601 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.204429 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.204748 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:08:21.204727 2527 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 15:08:21.204824 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:08:21.204812 2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs podName:3d04ae84-31a8-49df-9486-a52b6a3fe8f3 nodeName:}" failed. No retries permitted until 2026-06-03 15:08:21.704787489 +0000 UTC m=+281.838076386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs") pod "model-serving-api-6577596cd5-p8qb8" (UID: "3d04ae84-31a8-49df-9486-a52b6a3fe8f3") : secret "model-serving-api-tls" not found Jun 03 15:08:21.219269 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.219226 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcht\" (UniqueName: \"kubernetes.io/projected/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-kube-api-access-9pcht\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.602794 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.602749 2527 generic.go:358] "Generic (PLEG): container finished" podID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerID="8aea2fd9c3c0ec33cce97e059856d3f634a1119406a4783e4c94f7474788469b" exitCode=0 Jun 03 15:08:21.603113 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.602840 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" event={"ID":"0eff9c5e-bf33-49d5-9793-15f9975f0217","Type":"ContainerDied","Data":"8aea2fd9c3c0ec33cce97e059856d3f634a1119406a4783e4c94f7474788469b"} Jun 03 15:08:21.604266 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.604234 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lvbks" event={"ID":"9d28aad4-3db2-46b7-a48e-f9d085e0661a","Type":"ContainerStarted","Data":"83b439e92635e7a871551216841342501f789109eaf8c304b88e548f197ea7e7"} Jun 03 15:08:21.711146 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.711088 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.718582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.718528 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d04ae84-31a8-49df-9486-a52b6a3fe8f3-tls-certs\") pod \"model-serving-api-6577596cd5-p8qb8\" (UID: \"3d04ae84-31a8-49df-9486-a52b6a3fe8f3\") " pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:21.925712 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:21.925108 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:22.140029 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:22.139931 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-p8qb8"] Jun 03 15:08:22.611415 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:22.611375 2527 generic.go:358] "Generic (PLEG): container finished" podID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerID="dd76633b241ca191d3de4e2ca3dddaadfa57ba762f9835ee304dc55f48425c5a" exitCode=0 Jun 03 15:08:22.611601 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:22.611493 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" event={"ID":"0eff9c5e-bf33-49d5-9793-15f9975f0217","Type":"ContainerDied","Data":"dd76633b241ca191d3de4e2ca3dddaadfa57ba762f9835ee304dc55f48425c5a"} Jun 03 15:08:23.697762 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:23.697709 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d04ae84_31a8_49df_9486_a52b6a3fe8f3.slice/crio-d039ede42686d62cd875131680132f194af1ac5d259652947fe9f59784ead3d6 WatchSource:0}: Error finding container d039ede42686d62cd875131680132f194af1ac5d259652947fe9f59784ead3d6: Status 404 returned error can't find the container with id d039ede42686d62cd875131680132f194af1ac5d259652947fe9f59784ead3d6 Jun 03 15:08:24.469276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.469250 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:24.539675 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.539619 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util\") pod \"0eff9c5e-bf33-49d5-9793-15f9975f0217\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " Jun 03 15:08:24.539872 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.539708 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle\") pod \"0eff9c5e-bf33-49d5-9793-15f9975f0217\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " Jun 03 15:08:24.539872 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.539767 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqvhc\" (UniqueName: \"kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc\") pod \"0eff9c5e-bf33-49d5-9793-15f9975f0217\" (UID: \"0eff9c5e-bf33-49d5-9793-15f9975f0217\") " Jun 03 15:08:24.540797 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.540760 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle" (OuterVolumeSpecName: "bundle") pod "0eff9c5e-bf33-49d5-9793-15f9975f0217" (UID: "0eff9c5e-bf33-49d5-9793-15f9975f0217"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:08:24.542689 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.542640 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc" (OuterVolumeSpecName: "kube-api-access-tqvhc") pod "0eff9c5e-bf33-49d5-9793-15f9975f0217" (UID: "0eff9c5e-bf33-49d5-9793-15f9975f0217"). InnerVolumeSpecName "kube-api-access-tqvhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:08:24.547629 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.547569 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util" (OuterVolumeSpecName: "util") pod "0eff9c5e-bf33-49d5-9793-15f9975f0217" (UID: "0eff9c5e-bf33-49d5-9793-15f9975f0217"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:08:24.622013 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.621974 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" event={"ID":"3d04ae84-31a8-49df-9486-a52b6a3fe8f3","Type":"ContainerStarted","Data":"d039ede42686d62cd875131680132f194af1ac5d259652947fe9f59784ead3d6"} Jun 03 15:08:24.624547 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.624493 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" event={"ID":"0eff9c5e-bf33-49d5-9793-15f9975f0217","Type":"ContainerDied","Data":"433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0"} Jun 03 15:08:24.624547 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.624540 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="433a5fad734d7e8cab98b4f2cb144ca1fd9bae9048a7fb795d55984339051bd0" Jun 03 15:08:24.624791 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.624668 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48355dblg" Jun 03 15:08:24.641661 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.641621 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:24.641883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.641690 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eff9c5e-bf33-49d5-9793-15f9975f0217-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:24.641883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:24.641705 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvhc\" (UniqueName: \"kubernetes.io/projected/0eff9c5e-bf33-49d5-9793-15f9975f0217-kube-api-access-tqvhc\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:25.632122 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:25.632063 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lvbks" event={"ID":"9d28aad4-3db2-46b7-a48e-f9d085e0661a","Type":"ContainerStarted","Data":"ef8d6bc9d8c1dbf3cd764a11276bb8ab936d5e84fe084357000159a4e279ddd8"} Jun 03 15:08:25.632629 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:25.632366 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:25.634341 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:25.634293 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" event={"ID":"56deb6c1-002b-425d-8f6f-eb16801aeea3","Type":"ContainerStarted","Data":"688146c0995b1f4a8c12db745ebde9f16733de98f065fd5488a1a21005794384"} Jun 03 15:08:25.654484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:25.654414 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-lvbks" podStartSLOduration=2.590167544 podStartE2EDuration="6.654392937s" podCreationTimestamp="2026-06-03 15:08:19 +0000 UTC" firstStartedPulling="2026-06-03 15:08:21.001751055 +0000 UTC m=+281.135039934" lastFinishedPulling="2026-06-03 15:08:25.065976434 +0000 UTC m=+285.199265327" observedRunningTime="2026-06-03 15:08:25.651204737 +0000 UTC m=+285.784493631" watchObservedRunningTime="2026-06-03 15:08:25.654392937 +0000 UTC m=+285.787681839" Jun 03 15:08:25.673044 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:25.672969 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d85c64844-msjbs" podStartSLOduration=1.841501767 podStartE2EDuration="6.672947026s" podCreationTimestamp="2026-06-03 15:08:19 +0000 UTC" firstStartedPulling="2026-06-03 15:08:20.22094359 +0000 UTC m=+280.354232478" lastFinishedPulling="2026-06-03 15:08:25.052388842 +0000 UTC m=+285.185677737" observedRunningTime="2026-06-03 15:08:25.670493685 +0000 UTC m=+285.803782588" watchObservedRunningTime="2026-06-03 15:08:25.672947026 +0000 UTC m=+285.806235928" Jun 03 15:08:26.639787 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:26.639749 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" event={"ID":"3d04ae84-31a8-49df-9486-a52b6a3fe8f3","Type":"ContainerStarted","Data":"5e21c778ca8f8c64b4ea274843445e5356f6300b2e65ffe018dea8f3d26fa640"} Jun 03 15:08:26.640293 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:26.640274 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:26.661480 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:26.661415 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" podStartSLOduration=4.378663232 podStartE2EDuration="6.661399926s" podCreationTimestamp="2026-06-03 15:08:20 +0000 UTC" firstStartedPulling="2026-06-03 15:08:23.699787464 +0000 UTC m=+283.833076359" lastFinishedPulling="2026-06-03 15:08:25.982524171 +0000 UTC m=+286.115813053" observedRunningTime="2026-06-03 15:08:26.659183468 +0000 UTC m=+286.792472370" watchObservedRunningTime="2026-06-03 15:08:26.661399926 +0000 UTC m=+286.794688826" Jun 03 15:08:32.450563 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.450517 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4"] Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451022 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="extract" Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451042 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="extract" Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451076 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="util" Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451085 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="util" Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451097 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="pull" Jun 03 15:08:32.451102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451105 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="pull" Jun 03 15:08:32.451485 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.451213 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="0eff9c5e-bf33-49d5-9793-15f9975f0217" containerName="extract" Jun 03 15:08:32.453358 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.453334 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.462238 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.462202 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 15:08:32.462370 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.462200 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tr7m5\"" Jun 03 15:08:32.462837 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.462814 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w"] Jun 03 15:08:32.465360 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.465339 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.468623 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.468599 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 15:08:32.468734 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.468602 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sdz5n\"" Jun 03 15:08:32.475591 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.475564 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4"] Jun 03 15:08:32.486383 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.486348 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w"] Jun 03 15:08:32.615584 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.615539 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746a091a-6b49-4d6a-bb13-739ac387da73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.615584 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.615584 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cead805a-d731-4aba-9851-ea1f23b14a8a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.615809 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.615634 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrq8v\" (UniqueName: \"kubernetes.io/projected/cead805a-d731-4aba-9851-ea1f23b14a8a-kube-api-access-lrq8v\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.615809 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.615724 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4w8\" (UniqueName: \"kubernetes.io/projected/746a091a-6b49-4d6a-bb13-739ac387da73-kube-api-access-ps4w8\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.717075 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.716965 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746a091a-6b49-4d6a-bb13-739ac387da73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.717075 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.717017 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cead805a-d731-4aba-9851-ea1f23b14a8a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.717075 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.717065 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrq8v\" (UniqueName: \"kubernetes.io/projected/cead805a-d731-4aba-9851-ea1f23b14a8a-kube-api-access-lrq8v\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.717412 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.717188 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4w8\" (UniqueName: \"kubernetes.io/projected/746a091a-6b49-4d6a-bb13-739ac387da73-kube-api-access-ps4w8\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.719708 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.719677 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cead805a-d731-4aba-9851-ea1f23b14a8a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.719834 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.719804 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/746a091a-6b49-4d6a-bb13-739ac387da73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.735295 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.735250 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4w8\" (UniqueName: \"kubernetes.io/projected/746a091a-6b49-4d6a-bb13-739ac387da73-kube-api-access-ps4w8\") pod \"kserve-controller-manager-7c99ffcdcd-gvqj4\" (UID: \"746a091a-6b49-4d6a-bb13-739ac387da73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.746054 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.746011 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrq8v\" (UniqueName: \"kubernetes.io/projected/cead805a-d731-4aba-9851-ea1f23b14a8a-kube-api-access-lrq8v\") pod \"llmisvc-controller-manager-c6b9847d7-vl84w\" (UID: \"cead805a-d731-4aba-9851-ea1f23b14a8a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.764847 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.764798 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:32.776772 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.776733 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:32.991053 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:32.991019 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4"] Jun 03 15:08:32.991384 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:32.991353 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746a091a_6b49_4d6a_bb13_739ac387da73.slice/crio-246260b10726a2cfdf4b4f3b92571562c265d0d4c7307fb76a3cbf798fb3753f WatchSource:0}: Error finding container 246260b10726a2cfdf4b4f3b92571562c265d0d4c7307fb76a3cbf798fb3753f: Status 404 returned error can't find the container with id 246260b10726a2cfdf4b4f3b92571562c265d0d4c7307fb76a3cbf798fb3753f Jun 03 15:08:33.065149 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:33.065104 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w"] Jun 03 15:08:33.065900 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:33.065871 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcead805a_d731_4aba_9851_ea1f23b14a8a.slice/crio-908cf8b5af2753a3f669936c6e266395c906f14bd1bf3be37097c82dd4704622 WatchSource:0}: Error finding container 908cf8b5af2753a3f669936c6e266395c906f14bd1bf3be37097c82dd4704622: Status 404 returned error can't find the container with id 908cf8b5af2753a3f669936c6e266395c906f14bd1bf3be37097c82dd4704622 Jun 03 15:08:33.666347 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:33.666306 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" event={"ID":"746a091a-6b49-4d6a-bb13-739ac387da73","Type":"ContainerStarted","Data":"246260b10726a2cfdf4b4f3b92571562c265d0d4c7307fb76a3cbf798fb3753f"} Jun 03 15:08:33.667697 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:33.667666 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" event={"ID":"cead805a-d731-4aba-9851-ea1f23b14a8a","Type":"ContainerStarted","Data":"908cf8b5af2753a3f669936c6e266395c906f14bd1bf3be37097c82dd4704622"} Jun 03 15:08:34.976564 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:34.976519 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj"] Jun 03 15:08:34.979720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:34.979686 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:34.986644 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:34.986588 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:08:34.986907 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:34.986889 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:08:34.989701 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:34.989683 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:08:35.045231 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.045169 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj"] Jun 03 15:08:35.141054 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.140999 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgn6w\" (UniqueName: \"kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.141246 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.141063 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.141246 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.141108 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.242451 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.242343 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.242651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.242486 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgn6w\" (UniqueName: \"kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.242651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.242519 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.242843 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.242817 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.242908 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.242866 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.301247 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.301207 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgn6w\" (UniqueName: \"kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.590879 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.590776 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:35.809178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:35.809110 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj"] Jun 03 15:08:36.213925 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:36.213887 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944faa81_65cc_4bf4_85c9_47801844fa97.slice/crio-d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf WatchSource:0}: Error finding container d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf: Status 404 returned error can't find the container with id d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf Jun 03 15:08:36.642998 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.642913 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-lvbks" Jun 03 15:08:36.682358 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.682318 2527 generic.go:358] "Generic (PLEG): container finished" podID="944faa81-65cc-4bf4-85c9-47801844fa97" containerID="48dfb1ebe02f88aa76327fb20c9e6a64bd00275bc90ddb2cf3be38ed428512c1" exitCode=0 Jun 03 15:08:36.682581 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.682412 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" event={"ID":"944faa81-65cc-4bf4-85c9-47801844fa97","Type":"ContainerDied","Data":"48dfb1ebe02f88aa76327fb20c9e6a64bd00275bc90ddb2cf3be38ed428512c1"} Jun 03 15:08:36.682581 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.682454 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" event={"ID":"944faa81-65cc-4bf4-85c9-47801844fa97","Type":"ContainerStarted","Data":"d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf"} Jun 03 15:08:36.684307 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.684203 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" event={"ID":"746a091a-6b49-4d6a-bb13-739ac387da73","Type":"ContainerStarted","Data":"afad5d4835c5f980be99ea1e9eb4c2499d0dc791e8eb03aa45383dd9163b75f5"} Jun 03 15:08:36.684406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.684382 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:08:36.886444 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:36.886368 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" podStartSLOduration=1.630869778 podStartE2EDuration="4.886349918s" podCreationTimestamp="2026-06-03 15:08:32 +0000 UTC" firstStartedPulling="2026-06-03 15:08:32.992638594 +0000 UTC m=+293.125927473" lastFinishedPulling="2026-06-03 15:08:36.248118727 +0000 UTC m=+296.381407613" observedRunningTime="2026-06-03 15:08:36.831940881 +0000 UTC m=+296.965229799" watchObservedRunningTime="2026-06-03 15:08:36.886349918 +0000 UTC m=+297.019638798" Jun 03 15:08:37.689774 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:37.689735 2527 generic.go:358] "Generic (PLEG): container finished" podID="944faa81-65cc-4bf4-85c9-47801844fa97" containerID="43f47312ecbf9b1c6fcbc7bba1371ca4a052e37ef8ffa822db7bf7249cc68fce" exitCode=0 Jun 03 15:08:37.690276 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:37.689827 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" event={"ID":"944faa81-65cc-4bf4-85c9-47801844fa97","Type":"ContainerDied","Data":"43f47312ecbf9b1c6fcbc7bba1371ca4a052e37ef8ffa822db7bf7249cc68fce"} Jun 03 15:08:37.691453 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:37.691423 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" event={"ID":"cead805a-d731-4aba-9851-ea1f23b14a8a","Type":"ContainerStarted","Data":"ea170b6f4784aa7a7444e3803bfe13483dbf1f5b7469418c9930a2213d6d8fe8"} Jun 03 15:08:37.691683 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:37.691599 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:08:37.851788 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:37.851669 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" podStartSLOduration=1.911385677 podStartE2EDuration="5.85165283s" podCreationTimestamp="2026-06-03 15:08:32 +0000 UTC" firstStartedPulling="2026-06-03 15:08:33.067314799 +0000 UTC m=+293.200603677" lastFinishedPulling="2026-06-03 15:08:37.007581947 +0000 UTC m=+297.140870830" observedRunningTime="2026-06-03 15:08:37.848710475 +0000 UTC m=+297.981999375" watchObservedRunningTime="2026-06-03 15:08:37.85165283 +0000 UTC m=+297.984941731" Jun 03 15:08:38.651473 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:38.651436 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-p8qb8" Jun 03 15:08:38.697539 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:38.697501 2527 generic.go:358] "Generic (PLEG): container finished" podID="944faa81-65cc-4bf4-85c9-47801844fa97" containerID="c5ea2af3651675787ef3ee8352e15ececdcd5f61981b5c40cfb09e29d025cc5e" exitCode=0 Jun 03 15:08:38.698038 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:38.697582 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" event={"ID":"944faa81-65cc-4bf4-85c9-47801844fa97","Type":"ContainerDied","Data":"c5ea2af3651675787ef3ee8352e15ececdcd5f61981b5c40cfb09e29d025cc5e"} Jun 03 15:08:39.834651 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.834622 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:39.885327 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.885271 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle\") pod \"944faa81-65cc-4bf4-85c9-47801844fa97\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " Jun 03 15:08:39.885510 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.885412 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgn6w\" (UniqueName: \"kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w\") pod \"944faa81-65cc-4bf4-85c9-47801844fa97\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " Jun 03 15:08:39.885510 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.885464 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util\") pod \"944faa81-65cc-4bf4-85c9-47801844fa97\" (UID: \"944faa81-65cc-4bf4-85c9-47801844fa97\") " Jun 03 15:08:39.886704 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.886667 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle" (OuterVolumeSpecName: "bundle") pod "944faa81-65cc-4bf4-85c9-47801844fa97" (UID: "944faa81-65cc-4bf4-85c9-47801844fa97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:08:39.887813 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.887778 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w" (OuterVolumeSpecName: "kube-api-access-vgn6w") pod "944faa81-65cc-4bf4-85c9-47801844fa97" (UID: "944faa81-65cc-4bf4-85c9-47801844fa97"). InnerVolumeSpecName "kube-api-access-vgn6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:08:39.890806 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.890763 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util" (OuterVolumeSpecName: "util") pod "944faa81-65cc-4bf4-85c9-47801844fa97" (UID: "944faa81-65cc-4bf4-85c9-47801844fa97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:08:39.986644 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.986548 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgn6w\" (UniqueName: \"kubernetes.io/projected/944faa81-65cc-4bf4-85c9-47801844fa97-kube-api-access-vgn6w\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:39.986644 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.986587 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:39.986644 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:39.986604 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944faa81-65cc-4bf4-85c9-47801844fa97-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:08:40.453003 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:40.452972 2527 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:08:40.706683 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:40.706583 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" event={"ID":"944faa81-65cc-4bf4-85c9-47801844fa97","Type":"ContainerDied","Data":"d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf"} Jun 03 15:08:40.706683 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:40.706621 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an4jxj" Jun 03 15:08:40.706914 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:40.706624 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d362979234f303e3b4eb9897ce672cb7a6441f85b7dba0dd07d1d0c7013e3fcf" Jun 03 15:08:41.321373 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321327 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r4lss"] Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321707 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="pull" Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321721 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="pull" Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321735 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="extract" Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321741 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="extract" Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321764 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="util" Jun 03 15:08:41.321817 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321771 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="util" Jun 03 15:08:41.322102 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.321840 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="944faa81-65cc-4bf4-85c9-47801844fa97" containerName="extract" Jun 03 15:08:41.324290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.324261 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.327848 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.327816 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 15:08:41.328004 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.327987 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 15:08:41.336208 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.336184 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qlxvc\"" Jun 03 15:08:41.363407 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.363363 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r4lss"] Jun 03 15:08:41.396559 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.396519 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjghn\" (UniqueName: \"kubernetes.io/projected/37816640-05ca-4a7e-be4c-663d81294cc8-kube-api-access-fjghn\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.396768 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.396575 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/37816640-05ca-4a7e-be4c-663d81294cc8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.497602 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.497564 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjghn\" (UniqueName: \"kubernetes.io/projected/37816640-05ca-4a7e-be4c-663d81294cc8-kube-api-access-fjghn\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.497805 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.497613 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/37816640-05ca-4a7e-be4c-663d81294cc8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.500339 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.500305 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/37816640-05ca-4a7e-be4c-663d81294cc8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.528866 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.528831 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjghn\" (UniqueName: \"kubernetes.io/projected/37816640-05ca-4a7e-be4c-663d81294cc8-kube-api-access-fjghn\") pod \"servicemesh-operator3-55f49c5f94-r4lss\" (UID: \"37816640-05ca-4a7e-be4c-663d81294cc8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.633814 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.633704 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:41.833465 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.833424 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-r4lss"] Jun 03 15:08:41.846221 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:41.846185 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37816640_05ca_4a7e_be4c_663d81294cc8.slice/crio-dee5cbff928895fed30c7a3892be671afad122f50f8754e016ee0cfc9cec669e WatchSource:0}: Error finding container dee5cbff928895fed30c7a3892be671afad122f50f8754e016ee0cfc9cec669e: Status 404 returned error can't find the container with id dee5cbff928895fed30c7a3892be671afad122f50f8754e016ee0cfc9cec669e Jun 03 15:08:41.848878 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:41.848858 2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:08:42.718471 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:42.718418 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" event={"ID":"37816640-05ca-4a7e-be4c-663d81294cc8","Type":"ContainerStarted","Data":"dee5cbff928895fed30c7a3892be671afad122f50f8754e016ee0cfc9cec669e"} Jun 03 15:08:45.736185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:45.735317 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" event={"ID":"37816640-05ca-4a7e-be4c-663d81294cc8","Type":"ContainerStarted","Data":"7ec55f6878586013c23fe63a2e86836a791ad92642878d6c934c344422d6e94a"} Jun 03 15:08:45.736185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:45.736117 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:08:45.763759 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:45.763687 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" podStartSLOduration=1.070408377 podStartE2EDuration="4.763658031s" podCreationTimestamp="2026-06-03 15:08:41 +0000 UTC" firstStartedPulling="2026-06-03 15:08:41.848999122 +0000 UTC m=+301.982288000" lastFinishedPulling="2026-06-03 15:08:45.542248763 +0000 UTC m=+305.675537654" observedRunningTime="2026-06-03 15:08:45.760433247 +0000 UTC m=+305.893722148" watchObservedRunningTime="2026-06-03 15:08:45.763658031 +0000 UTC m=+305.896946933" Jun 03 15:08:50.077038 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.076984 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-lwpcf"] Jun 03 15:08:50.080166 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.080107 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.083918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.083890 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rtrn8\"" Jun 03 15:08:50.084251 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.084231 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 15:08:50.092627 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.092591 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-lwpcf"] Jun 03 15:08:50.179936 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.179885 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-redirect-config\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.180169 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.180000 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9mm\" (UniqueName: \"kubernetes.io/projected/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-kube-api-access-2b9mm\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.281417 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.281372 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-redirect-config\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.281625 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.281544 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9mm\" (UniqueName: \"kubernetes.io/projected/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-kube-api-access-2b9mm\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.282129 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.282110 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-redirect-config\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.291810 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.291768 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9mm\" (UniqueName: \"kubernetes.io/projected/d7e14a46-ceb0-4a46-85ac-8411acb98aaf-kube-api-access-2b9mm\") pod \"dashboard-redirect-86b6644fd4-lwpcf\" (UID: \"d7e14a46-ceb0-4a46-85ac-8411acb98aaf\") " pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.392361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.392252 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" Jun 03 15:08:50.531110 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.531077 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-lwpcf"] Jun 03 15:08:50.533238 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:08:50.533205 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e14a46_ceb0_4a46_85ac_8411acb98aaf.slice/crio-d0bd9b4d52db1d6b0af8e56bd2191ee92651320c8395a6482aae4ac48fa63a15 WatchSource:0}: Error finding container d0bd9b4d52db1d6b0af8e56bd2191ee92651320c8395a6482aae4ac48fa63a15: Status 404 returned error can't find the container with id d0bd9b4d52db1d6b0af8e56bd2191ee92651320c8395a6482aae4ac48fa63a15 Jun 03 15:08:50.755696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:50.755650 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" event={"ID":"d7e14a46-ceb0-4a46-85ac-8411acb98aaf","Type":"ContainerStarted","Data":"d0bd9b4d52db1d6b0af8e56bd2191ee92651320c8395a6482aae4ac48fa63a15"} Jun 03 15:08:55.774791 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:55.774749 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" event={"ID":"d7e14a46-ceb0-4a46-85ac-8411acb98aaf","Type":"ContainerStarted","Data":"41817cadf24da42e1c7891a5e29804d02c9c39181e3f0c8c5209b7b68105b97a"} Jun 03 15:08:55.794265 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:55.794208 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86b6644fd4-lwpcf" podStartSLOduration=0.717381728 podStartE2EDuration="5.794189353s" podCreationTimestamp="2026-06-03 15:08:50 +0000 UTC" firstStartedPulling="2026-06-03 15:08:50.53480414 +0000 UTC m=+310.668093018" lastFinishedPulling="2026-06-03 15:08:55.61161175 +0000 UTC m=+315.744900643" observedRunningTime="2026-06-03 15:08:55.792697363 +0000 UTC m=+315.925986266" watchObservedRunningTime="2026-06-03 15:08:55.794189353 +0000 UTC m=+315.927478254" Jun 03 15:08:57.745606 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:08:57.745574 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-r4lss" Jun 03 15:09:07.044402 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.044357 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw"] Jun 03 15:09:07.057473 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.057439 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.060999 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.060942 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 15:09:07.061619 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.061582 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 15:09:07.062607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.062579 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 15:09:07.062607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.062584 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 15:09:07.063563 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.063541 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6mch9\"" Jun 03 15:09:07.064045 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.064024 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw"] Jun 03 15:09:07.140505 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140457 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140525 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140565 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52cd03f9-dedb-44c2-a757-605af05ae5bd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140630 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140816 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140708 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8tnp\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-kube-api-access-q8tnp\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140816 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140777 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.140894 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.140803 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241349 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241409 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241463 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241496 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241524 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52cd03f9-dedb-44c2-a757-605af05ae5bd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241567 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.242484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.241623 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8tnp\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-kube-api-access-q8tnp\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.243669 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.243633 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.247153 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.247092 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/52cd03f9-dedb-44c2-a757-605af05ae5bd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.247512 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.247484 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.248242 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.248215 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.248322 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.248291 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/52cd03f9-dedb-44c2-a757-605af05ae5bd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.251958 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.251929 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8tnp\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-kube-api-access-q8tnp\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.253107 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.253085 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52cd03f9-dedb-44c2-a757-605af05ae5bd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6llhw\" (UID: \"52cd03f9-dedb-44c2-a757-605af05ae5bd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.369371 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.369272 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:07.526849 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.526817 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw"] Jun 03 15:09:07.529011 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:07.528980 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cd03f9_dedb_44c2_a757_605af05ae5bd.slice/crio-63f6dd1058e3c2be05fb70044a389ebfe5f6c7732b81d64119d28a6f89e344f8 WatchSource:0}: Error finding container 63f6dd1058e3c2be05fb70044a389ebfe5f6c7732b81d64119d28a6f89e344f8: Status 404 returned error can't find the container with id 63f6dd1058e3c2be05fb70044a389ebfe5f6c7732b81d64119d28a6f89e344f8 Jun 03 15:09:07.698015 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.697984 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gvqj4" Jun 03 15:09:07.822013 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:07.821974 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" event={"ID":"52cd03f9-dedb-44c2-a757-605af05ae5bd","Type":"ContainerStarted","Data":"63f6dd1058e3c2be05fb70044a389ebfe5f6c7732b81d64119d28a6f89e344f8"} Jun 03 15:09:08.700110 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:08.700076 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-vl84w" Jun 03 15:09:14.525772 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:14.525726 2527 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 15:09:14.526178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:14.525814 2527 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 15:09:14.854749 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:14.854656 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" event={"ID":"52cd03f9-dedb-44c2-a757-605af05ae5bd","Type":"ContainerStarted","Data":"38f2788f10ca0d8398f90622356a81674c48b07865d670c982cb4d084d706d95"} Jun 03 15:09:14.854749 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:14.854716 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:14.882864 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:14.882812 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" podStartSLOduration=0.888350689 podStartE2EDuration="7.88279774s" podCreationTimestamp="2026-06-03 15:09:07 +0000 UTC" firstStartedPulling="2026-06-03 15:09:07.531021215 +0000 UTC m=+327.664310094" lastFinishedPulling="2026-06-03 15:09:14.525468267 +0000 UTC m=+334.658757145" observedRunningTime="2026-06-03 15:09:14.881212585 +0000 UTC m=+335.014501486" watchObservedRunningTime="2026-06-03 15:09:14.88279774 +0000 UTC m=+335.016086641" Jun 03 15:09:15.860936 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:15.860904 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6llhw" Jun 03 15:09:20.606478 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.606435 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:20.609124 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.609103 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:20.612371 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.612339 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:09:20.613856 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.613828 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xxmp9\"" Jun 03 15:09:20.613972 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.613833 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:09:20.619290 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.619252 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:20.769756 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.769709 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r27vm\" (UniqueName: \"kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm\") pod \"kuadrant-operator-catalog-mnzj9\" (UID: \"992cc033-bd4d-442b-b549-757e0cfe877c\") " pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:20.871099 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.870991 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r27vm\" (UniqueName: \"kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm\") pod \"kuadrant-operator-catalog-mnzj9\" (UID: \"992cc033-bd4d-442b-b549-757e0cfe877c\") " pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:20.884849 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.884808 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r27vm\" (UniqueName: \"kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm\") pod \"kuadrant-operator-catalog-mnzj9\" (UID: \"992cc033-bd4d-442b-b549-757e0cfe877c\") " pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:20.920765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.920716 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:20.942159 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:20.942107 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:21.060953 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.060768 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:21.064588 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:21.064556 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992cc033_bd4d_442b_b549_757e0cfe877c.slice/crio-05270d251e6ab256286ad12817e2a8f939071082e0b88a81ee99c4e617b823bd WatchSource:0}: Error finding container 05270d251e6ab256286ad12817e2a8f939071082e0b88a81ee99c4e617b823bd: Status 404 returned error can't find the container with id 05270d251e6ab256286ad12817e2a8f939071082e0b88a81ee99c4e617b823bd Jun 03 15:09:21.152368 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.152270 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88qvs"] Jun 03 15:09:21.155562 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.155532 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:21.163914 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.163883 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88qvs"] Jun 03 15:09:21.275047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.275000 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9hq\" (UniqueName: \"kubernetes.io/projected/4e795459-c614-4bbd-a99b-cae043b27870-kube-api-access-ng9hq\") pod \"kuadrant-operator-catalog-88qvs\" (UID: \"4e795459-c614-4bbd-a99b-cae043b27870\") " pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:21.376269 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.376214 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9hq\" (UniqueName: \"kubernetes.io/projected/4e795459-c614-4bbd-a99b-cae043b27870-kube-api-access-ng9hq\") pod \"kuadrant-operator-catalog-88qvs\" (UID: \"4e795459-c614-4bbd-a99b-cae043b27870\") " pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:21.386105 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.386069 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9hq\" (UniqueName: \"kubernetes.io/projected/4e795459-c614-4bbd-a99b-cae043b27870-kube-api-access-ng9hq\") pod \"kuadrant-operator-catalog-88qvs\" (UID: \"4e795459-c614-4bbd-a99b-cae043b27870\") " pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:21.467279 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.467235 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:21.611805 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.611777 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88qvs"] Jun 03 15:09:21.613859 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:21.613831 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e795459_c614_4bbd_a99b_cae043b27870.slice/crio-a8ec2a398bc0788f9c6a01331d8de273663b204076e756f711edaca2f616b2c6 WatchSource:0}: Error finding container a8ec2a398bc0788f9c6a01331d8de273663b204076e756f711edaca2f616b2c6: Status 404 returned error can't find the container with id a8ec2a398bc0788f9c6a01331d8de273663b204076e756f711edaca2f616b2c6 Jun 03 15:09:21.882301 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.882205 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" event={"ID":"4e795459-c614-4bbd-a99b-cae043b27870","Type":"ContainerStarted","Data":"a8ec2a398bc0788f9c6a01331d8de273663b204076e756f711edaca2f616b2c6"} Jun 03 15:09:21.883361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:21.883331 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" event={"ID":"992cc033-bd4d-442b-b549-757e0cfe877c","Type":"ContainerStarted","Data":"05270d251e6ab256286ad12817e2a8f939071082e0b88a81ee99c4e617b823bd"} Jun 03 15:09:23.893312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:23.893271 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" event={"ID":"4e795459-c614-4bbd-a99b-cae043b27870","Type":"ContainerStarted","Data":"6167dc793718e6511de6f537c2ba24effb37372145397c2c8c53808f40d3e19b"} Jun 03 15:09:23.894829 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:23.894801 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" event={"ID":"992cc033-bd4d-442b-b549-757e0cfe877c","Type":"ContainerStarted","Data":"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab"} Jun 03 15:09:23.894975 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:23.894876 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" podUID="992cc033-bd4d-442b-b549-757e0cfe877c" containerName="registry-server" containerID="cri-o://afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab" gracePeriod=2 Jun 03 15:09:23.916024 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:23.915968 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" podStartSLOduration=1.145268698 podStartE2EDuration="2.915950674s" podCreationTimestamp="2026-06-03 15:09:21 +0000 UTC" firstStartedPulling="2026-06-03 15:09:21.615318476 +0000 UTC m=+341.748607354" lastFinishedPulling="2026-06-03 15:09:23.386000447 +0000 UTC m=+343.519289330" observedRunningTime="2026-06-03 15:09:23.91323139 +0000 UTC m=+344.046520288" watchObservedRunningTime="2026-06-03 15:09:23.915950674 +0000 UTC m=+344.049239575" Jun 03 15:09:23.932026 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:23.931965 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" podStartSLOduration=1.614543148 podStartE2EDuration="3.931944738s" podCreationTimestamp="2026-06-03 15:09:20 +0000 UTC" firstStartedPulling="2026-06-03 15:09:21.065940455 +0000 UTC m=+341.199229335" lastFinishedPulling="2026-06-03 15:09:23.383342042 +0000 UTC m=+343.516630925" observedRunningTime="2026-06-03 15:09:23.931616808 +0000 UTC m=+344.064905710" watchObservedRunningTime="2026-06-03 15:09:23.931944738 +0000 UTC m=+344.065233642" Jun 03 15:09:24.145214 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.145108 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:24.305216 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.305180 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r27vm\" (UniqueName: \"kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm\") pod \"992cc033-bd4d-442b-b549-757e0cfe877c\" (UID: \"992cc033-bd4d-442b-b549-757e0cfe877c\") " Jun 03 15:09:24.307476 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.307448 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm" (OuterVolumeSpecName: "kube-api-access-r27vm") pod "992cc033-bd4d-442b-b549-757e0cfe877c" (UID: "992cc033-bd4d-442b-b549-757e0cfe877c"). InnerVolumeSpecName "kube-api-access-r27vm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:09:24.406259 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.406159 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r27vm\" (UniqueName: \"kubernetes.io/projected/992cc033-bd4d-442b-b549-757e0cfe877c-kube-api-access-r27vm\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:24.899785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.899696 2527 generic.go:358] "Generic (PLEG): container finished" podID="992cc033-bd4d-442b-b549-757e0cfe877c" containerID="afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab" exitCode=0 Jun 03 15:09:24.899785 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.899766 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" Jun 03 15:09:24.900322 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.899779 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" event={"ID":"992cc033-bd4d-442b-b549-757e0cfe877c","Type":"ContainerDied","Data":"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab"} Jun 03 15:09:24.900322 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.899820 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnzj9" event={"ID":"992cc033-bd4d-442b-b549-757e0cfe877c","Type":"ContainerDied","Data":"05270d251e6ab256286ad12817e2a8f939071082e0b88a81ee99c4e617b823bd"} Jun 03 15:09:24.900322 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.899836 2527 scope.go:117] "RemoveContainer" containerID="afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab" Jun 03 15:09:24.909187 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.909164 2527 scope.go:117] "RemoveContainer" containerID="afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab" Jun 03 15:09:24.909582 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:09:24.909560 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab\": container with ID starting with afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab not found: ID does not exist" containerID="afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab" Jun 03 15:09:24.909636 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.909595 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab"} err="failed to get container status \"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab\": rpc error: code = NotFound desc = could not find container \"afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab\": container with ID starting with afc2fedc26c15537b0a129097e9e33a0cb6d65aa6a631b5bd838d0e035524bab not found: ID does not exist" Jun 03 15:09:24.920489 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.920439 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:24.925160 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:24.925114 2527 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnzj9"] Jun 03 15:09:26.546906 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:26.546870 2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992cc033-bd4d-442b-b549-757e0cfe877c" path="/var/lib/kubelet/pods/992cc033-bd4d-442b-b549-757e0cfe877c/volumes" Jun 03 15:09:31.468261 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:31.468206 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:31.468261 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:31.468272 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:31.491984 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:31.491953 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:31.953260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:31.953228 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-88qvs" Jun 03 15:09:36.038818 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.038777 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8"] Jun 03 15:09:36.039249 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.039188 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992cc033-bd4d-442b-b549-757e0cfe877c" containerName="registry-server" Jun 03 15:09:36.039249 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.039201 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="992cc033-bd4d-442b-b549-757e0cfe877c" containerName="registry-server" Jun 03 15:09:36.039341 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.039281 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="992cc033-bd4d-442b-b549-757e0cfe877c" containerName="registry-server" Jun 03 15:09:36.069051 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.069018 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8"] Jun 03 15:09:36.069227 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.069161 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.074641 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.074608 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8kb7\"" Jun 03 15:09:36.085801 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.085768 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.085987 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.085824 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.085987 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.085882 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnjds\" (UniqueName: \"kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.186514 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.186466 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.186707 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.186556 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnjds\" (UniqueName: \"kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.186707 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.186631 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.187021 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.186876 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.187021 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.186945 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.197607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.197573 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnjds\" (UniqueName: \"kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.378487 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.378386 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:36.518201 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.518145 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8"] Jun 03 15:09:36.520610 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:36.520577 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde358631_1d8d_420e_b2bc_fed3e0e63afc.slice/crio-365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2 WatchSource:0}: Error finding container 365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2: Status 404 returned error can't find the container with id 365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2 Jun 03 15:09:36.602442 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.602401 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh"] Jun 03 15:09:36.605372 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.605352 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.617079 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.617044 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh"] Jun 03 15:09:36.691421 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.691328 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsgq5\" (UniqueName: \"kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.691421 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.691387 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.691612 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.691482 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.792476 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.792438 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.792682 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.792526 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.792682 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.792576 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsgq5\" (UniqueName: \"kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.792913 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.792887 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.792913 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.792906 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.802516 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.802488 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsgq5\" (UniqueName: \"kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.915963 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.915916 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:36.950674 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.950638 2527 generic.go:358] "Generic (PLEG): container finished" podID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerID="0b9c4714d75ac6ce26407b9e4a4ed0a9161c14769f25cf9f8aafad981c723a6f" exitCode=0 Jun 03 15:09:36.950865 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.950703 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" event={"ID":"de358631-1d8d-420e-b2bc-fed3e0e63afc","Type":"ContainerDied","Data":"0b9c4714d75ac6ce26407b9e4a4ed0a9161c14769f25cf9f8aafad981c723a6f"} Jun 03 15:09:36.950865 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.950731 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" event={"ID":"de358631-1d8d-420e-b2bc-fed3e0e63afc","Type":"ContainerStarted","Data":"365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2"} Jun 03 15:09:36.994687 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.994644 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw"] Jun 03 15:09:36.997946 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:36.997919 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.012787 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.009213 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw"] Jun 03 15:09:37.062867 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.062842 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh"] Jun 03 15:09:37.064714 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:37.064686 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3a0c98_1173_41da_ad83_c9e6f605ae1d.slice/crio-6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e WatchSource:0}: Error finding container 6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e: Status 404 returned error can't find the container with id 6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e Jun 03 15:09:37.095409 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.095377 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.095571 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.095475 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.095571 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.095526 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksq8k\" (UniqueName: \"kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.196202 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.196161 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.196375 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.196236 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksq8k\" (UniqueName: \"kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.196375 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.196308 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.196568 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.196547 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.196648 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.196628 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.207010 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.206930 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksq8k\" (UniqueName: \"kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.310842 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.310799 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:37.405080 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.405043 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf"] Jun 03 15:09:37.408533 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.408508 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.418105 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.418043 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf"] Jun 03 15:09:37.469801 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.469770 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw"] Jun 03 15:09:37.471661 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:37.471619 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96ef5cc_20eb_41b2_afbf_9e861be892a8.slice/crio-6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598 WatchSource:0}: Error finding container 6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598: Status 404 returned error can't find the container with id 6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598 Jun 03 15:09:37.498618 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.498581 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgnmw\" (UniqueName: \"kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.498796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.498657 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.498796 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.498685 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.599305 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.599260 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgnmw\" (UniqueName: \"kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.599496 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.599345 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.599496 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.599377 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.599818 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.599791 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.599859 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.599799 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.610415 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.610356 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgnmw\" (UniqueName: \"kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.725307 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.725220 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:37.892667 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.892634 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf"] Jun 03 15:09:37.899246 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:37.899205 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc46216_4f5f_4614_a16e_d6b138b4ffcf.slice/crio-3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7 WatchSource:0}: Error finding container 3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7: Status 404 returned error can't find the container with id 3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7 Jun 03 15:09:37.956683 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.956648 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" event={"ID":"fbc46216-4f5f-4614-a16e-d6b138b4ffcf","Type":"ContainerStarted","Data":"3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7"} Jun 03 15:09:37.958299 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.958264 2527 generic.go:358] "Generic (PLEG): container finished" podID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerID="fa07880df14f0ca7729fd685a76db9b5e46a49e46cbce9765c8e2527379e4a29" exitCode=0 Jun 03 15:09:37.958434 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.958331 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" event={"ID":"de358631-1d8d-420e-b2bc-fed3e0e63afc","Type":"ContainerDied","Data":"fa07880df14f0ca7729fd685a76db9b5e46a49e46cbce9765c8e2527379e4a29"} Jun 03 15:09:37.959760 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.959734 2527 generic.go:358] "Generic (PLEG): container finished" podID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerID="4d5ab9cfbbf9d54ff8bff6a7112b55de6a9c52311dfdf7c8fb8950cddc0d06c9" exitCode=0 Jun 03 15:09:37.959883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.959816 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" event={"ID":"a96ef5cc-20eb-41b2-afbf-9e861be892a8","Type":"ContainerDied","Data":"4d5ab9cfbbf9d54ff8bff6a7112b55de6a9c52311dfdf7c8fb8950cddc0d06c9"} Jun 03 15:09:37.959883 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.959851 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" event={"ID":"a96ef5cc-20eb-41b2-afbf-9e861be892a8","Type":"ContainerStarted","Data":"6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598"} Jun 03 15:09:37.961207 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.961186 2527 generic.go:358] "Generic (PLEG): container finished" podID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerID="7caa6b5a1ab0d3484ec9ebd100d6af72f1b7b98ed0da5561350d32974782ba35" exitCode=0 Jun 03 15:09:37.961308 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.961232 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" event={"ID":"8f3a0c98-1173-41da-ad83-c9e6f605ae1d","Type":"ContainerDied","Data":"7caa6b5a1ab0d3484ec9ebd100d6af72f1b7b98ed0da5561350d32974782ba35"} Jun 03 15:09:37.961308 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:37.961257 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" event={"ID":"8f3a0c98-1173-41da-ad83-c9e6f605ae1d","Type":"ContainerStarted","Data":"6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e"} Jun 03 15:09:38.967192 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.967122 2527 generic.go:358] "Generic (PLEG): container finished" podID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerID="f240b873ca0d71a747e8f3b8739c7a11e35cb1f33ca98dc837f1278f0a90e44d" exitCode=0 Jun 03 15:09:38.967811 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.967204 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" event={"ID":"fbc46216-4f5f-4614-a16e-d6b138b4ffcf","Type":"ContainerDied","Data":"f240b873ca0d71a747e8f3b8739c7a11e35cb1f33ca98dc837f1278f0a90e44d"} Jun 03 15:09:38.969342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.969311 2527 generic.go:358] "Generic (PLEG): container finished" podID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerID="b40e50f9fdd1fa7f0f121377cf34e6772d5c69c1643b595dbdd149b09ef13db2" exitCode=0 Jun 03 15:09:38.969468 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.969390 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" event={"ID":"de358631-1d8d-420e-b2bc-fed3e0e63afc","Type":"ContainerDied","Data":"b40e50f9fdd1fa7f0f121377cf34e6772d5c69c1643b595dbdd149b09ef13db2"} Jun 03 15:09:38.971204 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.971176 2527 generic.go:358] "Generic (PLEG): container finished" podID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerID="c362aa5b21de97f325145becee04d99756029080bfb12d7715f7b7553c1b7e29" exitCode=0 Jun 03 15:09:38.971313 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.971259 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" event={"ID":"a96ef5cc-20eb-41b2-afbf-9e861be892a8","Type":"ContainerDied","Data":"c362aa5b21de97f325145becee04d99756029080bfb12d7715f7b7553c1b7e29"} Jun 03 15:09:38.973037 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.973016 2527 generic.go:358] "Generic (PLEG): container finished" podID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerID="150b0f7f0e891409b6e0e6cbcaaa7148aa13152f356cb858f8d634e646b2952f" exitCode=0 Jun 03 15:09:38.973143 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:38.973111 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" event={"ID":"8f3a0c98-1173-41da-ad83-c9e6f605ae1d","Type":"ContainerDied","Data":"150b0f7f0e891409b6e0e6cbcaaa7148aa13152f356cb858f8d634e646b2952f"} Jun 03 15:09:39.979622 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.979520 2527 generic.go:358] "Generic (PLEG): container finished" podID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerID="621d79cf5bf7ef0dfab0515b3b9373564efbeef5f3bd7cf751ae7faf8c5f2350" exitCode=0 Jun 03 15:09:39.980036 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.979609 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" event={"ID":"a96ef5cc-20eb-41b2-afbf-9e861be892a8","Type":"ContainerDied","Data":"621d79cf5bf7ef0dfab0515b3b9373564efbeef5f3bd7cf751ae7faf8c5f2350"} Jun 03 15:09:39.981624 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.981597 2527 generic.go:358] "Generic (PLEG): container finished" podID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerID="b1df72f37737df78b1c80c2a6cb2a956a588e4303cd2384ac98b1d00bd509b41" exitCode=0 Jun 03 15:09:39.981765 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.981658 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" event={"ID":"8f3a0c98-1173-41da-ad83-c9e6f605ae1d","Type":"ContainerDied","Data":"b1df72f37737df78b1c80c2a6cb2a956a588e4303cd2384ac98b1d00bd509b41"} Jun 03 15:09:39.983381 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.983358 2527 generic.go:358] "Generic (PLEG): container finished" podID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerID="f90d2fba596854d24cb15dfe66476b44354a8d4126e7fb3cb455981ce142d93a" exitCode=0 Jun 03 15:09:39.983499 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:39.983436 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" event={"ID":"fbc46216-4f5f-4614-a16e-d6b138b4ffcf","Type":"ContainerDied","Data":"f90d2fba596854d24cb15dfe66476b44354a8d4126e7fb3cb455981ce142d93a"} Jun 03 15:09:40.120600 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.120573 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:40.220443 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.220417 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util\") pod \"de358631-1d8d-420e-b2bc-fed3e0e63afc\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " Jun 03 15:09:40.220562 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.220458 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle\") pod \"de358631-1d8d-420e-b2bc-fed3e0e63afc\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " Jun 03 15:09:40.220936 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.220912 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle" (OuterVolumeSpecName: "bundle") pod "de358631-1d8d-420e-b2bc-fed3e0e63afc" (UID: "de358631-1d8d-420e-b2bc-fed3e0e63afc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:40.225763 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.225732 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util" (OuterVolumeSpecName: "util") pod "de358631-1d8d-420e-b2bc-fed3e0e63afc" (UID: "de358631-1d8d-420e-b2bc-fed3e0e63afc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:40.321109 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.320986 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnjds\" (UniqueName: \"kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds\") pod \"de358631-1d8d-420e-b2bc-fed3e0e63afc\" (UID: \"de358631-1d8d-420e-b2bc-fed3e0e63afc\") " Jun 03 15:09:40.321333 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.321314 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:40.321408 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.321340 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de358631-1d8d-420e-b2bc-fed3e0e63afc-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:40.323058 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.323032 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds" (OuterVolumeSpecName: "kube-api-access-rnjds") pod "de358631-1d8d-420e-b2bc-fed3e0e63afc" (UID: "de358631-1d8d-420e-b2bc-fed3e0e63afc"). InnerVolumeSpecName "kube-api-access-rnjds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:09:40.422122 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.422083 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnjds\" (UniqueName: \"kubernetes.io/projected/de358631-1d8d-420e-b2bc-fed3e0e63afc-kube-api-access-rnjds\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:40.991031 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.990993 2527 generic.go:358] "Generic (PLEG): container finished" podID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerID="f479d1321c4a95fd0fdaf4201fbb075e7295343a14add15172c1ba3bb2d55a0f" exitCode=0 Jun 03 15:09:40.991525 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.991077 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" event={"ID":"fbc46216-4f5f-4614-a16e-d6b138b4ffcf","Type":"ContainerDied","Data":"f479d1321c4a95fd0fdaf4201fbb075e7295343a14add15172c1ba3bb2d55a0f"} Jun 03 15:09:40.992788 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.992766 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" Jun 03 15:09:40.992788 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.992771 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8" event={"ID":"de358631-1d8d-420e-b2bc-fed3e0e63afc","Type":"ContainerDied","Data":"365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2"} Jun 03 15:09:40.992955 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:40.992799 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="365193bc083e57e9bf6818d4135b93f54c5d142982a6d4bf4e9c58e7d1c5a5a2" Jun 03 15:09:41.161298 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.161272 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:41.164329 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.164305 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:41.229566 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229529 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsgq5\" (UniqueName: \"kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5\") pod \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " Jun 03 15:09:41.229566 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229570 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksq8k\" (UniqueName: \"kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k\") pod \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " Jun 03 15:09:41.229828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229680 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util\") pod \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " Jun 03 15:09:41.229828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229724 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle\") pod \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " Jun 03 15:09:41.229828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229789 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle\") pod \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\" (UID: \"a96ef5cc-20eb-41b2-afbf-9e861be892a8\") " Jun 03 15:09:41.229828 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.229818 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util\") pod \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\" (UID: \"8f3a0c98-1173-41da-ad83-c9e6f605ae1d\") " Jun 03 15:09:41.230600 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.230291 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle" (OuterVolumeSpecName: "bundle") pod "a96ef5cc-20eb-41b2-afbf-9e861be892a8" (UID: "a96ef5cc-20eb-41b2-afbf-9e861be892a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:41.230600 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.230538 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle" (OuterVolumeSpecName: "bundle") pod "8f3a0c98-1173-41da-ad83-c9e6f605ae1d" (UID: "8f3a0c98-1173-41da-ad83-c9e6f605ae1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:41.232364 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.232333 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k" (OuterVolumeSpecName: "kube-api-access-ksq8k") pod "a96ef5cc-20eb-41b2-afbf-9e861be892a8" (UID: "a96ef5cc-20eb-41b2-afbf-9e861be892a8"). InnerVolumeSpecName "kube-api-access-ksq8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:09:41.232508 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.232489 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5" (OuterVolumeSpecName: "kube-api-access-lsgq5") pod "8f3a0c98-1173-41da-ad83-c9e6f605ae1d" (UID: "8f3a0c98-1173-41da-ad83-c9e6f605ae1d"). InnerVolumeSpecName "kube-api-access-lsgq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:09:41.236378 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.236349 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util" (OuterVolumeSpecName: "util") pod "a96ef5cc-20eb-41b2-afbf-9e861be892a8" (UID: "a96ef5cc-20eb-41b2-afbf-9e861be892a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:41.236657 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.236633 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util" (OuterVolumeSpecName: "util") pod "8f3a0c98-1173-41da-ad83-c9e6f605ae1d" (UID: "8f3a0c98-1173-41da-ad83-c9e6f605ae1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330488 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330527 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330541 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsgq5\" (UniqueName: \"kubernetes.io/projected/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-kube-api-access-lsgq5\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330553 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksq8k\" (UniqueName: \"kubernetes.io/projected/a96ef5cc-20eb-41b2-afbf-9e861be892a8-kube-api-access-ksq8k\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330567 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a96ef5cc-20eb-41b2-afbf-9e861be892a8-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.330598 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.330578 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f3a0c98-1173-41da-ad83-c9e6f605ae1d-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:41.998285 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.998243 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" event={"ID":"a96ef5cc-20eb-41b2-afbf-9e861be892a8","Type":"ContainerDied","Data":"6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598"} Jun 03 15:09:41.998285 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.998291 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cf69598aecf5ea52e9a95724806557f9fbe926c6363655210b9cec8f3e8b598" Jun 03 15:09:41.998771 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:41.998262 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw" Jun 03 15:09:42.000227 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.000204 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" Jun 03 15:09:42.000375 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.000224 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh" event={"ID":"8f3a0c98-1173-41da-ad83-c9e6f605ae1d","Type":"ContainerDied","Data":"6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e"} Jun 03 15:09:42.000375 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.000252 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b6e44640e5e6c733f81636ddc86b6743becdf4b499c2c9e8a7048e531c0ff5e" Jun 03 15:09:42.137350 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.137325 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:42.236515 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.236472 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgnmw\" (UniqueName: \"kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw\") pod \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " Jun 03 15:09:42.236698 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.236555 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle\") pod \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " Jun 03 15:09:42.236698 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.236583 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util\") pod \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\" (UID: \"fbc46216-4f5f-4614-a16e-d6b138b4ffcf\") " Jun 03 15:09:42.237095 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.237066 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle" (OuterVolumeSpecName: "bundle") pod "fbc46216-4f5f-4614-a16e-d6b138b4ffcf" (UID: "fbc46216-4f5f-4614-a16e-d6b138b4ffcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:42.238750 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.238725 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw" (OuterVolumeSpecName: "kube-api-access-fgnmw") pod "fbc46216-4f5f-4614-a16e-d6b138b4ffcf" (UID: "fbc46216-4f5f-4614-a16e-d6b138b4ffcf"). InnerVolumeSpecName "kube-api-access-fgnmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:09:42.241936 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.241901 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util" (OuterVolumeSpecName: "util") pod "fbc46216-4f5f-4614-a16e-d6b138b4ffcf" (UID: "fbc46216-4f5f-4614-a16e-d6b138b4ffcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:09:42.337406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.337312 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgnmw\" (UniqueName: \"kubernetes.io/projected/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-kube-api-access-fgnmw\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:42.337406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.337345 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:42.337406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:42.337355 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc46216-4f5f-4614-a16e-d6b138b4ffcf-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:09:43.006477 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:43.006451 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" Jun 03 15:09:43.006477 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:43.006465 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf" event={"ID":"fbc46216-4f5f-4614-a16e-d6b138b4ffcf","Type":"ContainerDied","Data":"3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7"} Jun 03 15:09:43.006885 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:43.006497 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b998b2f5f07ab28d76a53a9c7d89ce33dc06a43b633fb98d8c9214bfeca9da7" Jun 03 15:09:53.215394 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215357 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-bnqb8"] Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215720 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215732 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215739 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215745 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215751 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215755 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215765 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215771 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215777 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215782 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215788 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215793 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215800 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215805 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="extract" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215813 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215818 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215828 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215832 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215840 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215844 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="util" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215849 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215853 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215862 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="pull" Jun 03 15:09:53.215870 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215867 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="pull" Jun 03 15:09:53.216625 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215919 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbc46216-4f5f-4614-a16e-d6b138b4ffcf" containerName="extract" Jun 03 15:09:53.216625 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215929 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f3a0c98-1173-41da-ad83-c9e6f605ae1d" containerName="extract" Jun 03 15:09:53.216625 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215936 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="de358631-1d8d-420e-b2bc-fed3e0e63afc" containerName="extract" Jun 03 15:09:53.216625 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.215943 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="a96ef5cc-20eb-41b2-afbf-9e861be892a8" containerName="extract" Jun 03 15:09:53.220436 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.220412 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:53.229941 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.229913 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jdbw5\"" Jun 03 15:09:53.238935 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.238898 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-bnqb8"] Jun 03 15:09:53.337235 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.337185 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pb79\" (UniqueName: \"kubernetes.io/projected/2b2aeb6b-0513-49fe-9535-abadf277422f-kube-api-access-2pb79\") pod \"authorino-operator-657f44b778-bnqb8\" (UID: \"2b2aeb6b-0513-49fe-9535-abadf277422f\") " pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:53.438641 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.438597 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pb79\" (UniqueName: \"kubernetes.io/projected/2b2aeb6b-0513-49fe-9535-abadf277422f-kube-api-access-2pb79\") pod \"authorino-operator-657f44b778-bnqb8\" (UID: \"2b2aeb6b-0513-49fe-9535-abadf277422f\") " pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:53.461692 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.461646 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pb79\" (UniqueName: \"kubernetes.io/projected/2b2aeb6b-0513-49fe-9535-abadf277422f-kube-api-access-2pb79\") pod \"authorino-operator-657f44b778-bnqb8\" (UID: \"2b2aeb6b-0513-49fe-9535-abadf277422f\") " pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:53.531448 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.531352 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:53.691730 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:53.691702 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-bnqb8"] Jun 03 15:09:53.693661 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:09:53.693630 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2aeb6b_0513_49fe_9535_abadf277422f.slice/crio-2c3c76f70eacbd781a81670e2ea647063b2d4eb3f40fef42044b351dd71384bb WatchSource:0}: Error finding container 2c3c76f70eacbd781a81670e2ea647063b2d4eb3f40fef42044b351dd71384bb: Status 404 returned error can't find the container with id 2c3c76f70eacbd781a81670e2ea647063b2d4eb3f40fef42044b351dd71384bb Jun 03 15:09:54.057466 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:54.057426 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" event={"ID":"2b2aeb6b-0513-49fe-9535-abadf277422f","Type":"ContainerStarted","Data":"2c3c76f70eacbd781a81670e2ea647063b2d4eb3f40fef42044b351dd71384bb"} Jun 03 15:09:57.071841 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:57.071803 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" event={"ID":"2b2aeb6b-0513-49fe-9535-abadf277422f","Type":"ContainerStarted","Data":"6bf8bab607f19c453cb0968b971b35c79dccec270143ee9f13d4eacff69afaf5"} Jun 03 15:09:57.072300 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:57.071885 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:09:57.095696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:09:57.095639 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" podStartSLOduration=1.6903262159999999 podStartE2EDuration="4.095623682s" podCreationTimestamp="2026-06-03 15:09:53 +0000 UTC" firstStartedPulling="2026-06-03 15:09:53.69555109 +0000 UTC m=+373.828839969" lastFinishedPulling="2026-06-03 15:09:56.100848556 +0000 UTC m=+376.234137435" observedRunningTime="2026-06-03 15:09:57.094929258 +0000 UTC m=+377.228218159" watchObservedRunningTime="2026-06-03 15:09:57.095623682 +0000 UTC m=+377.228912583" Jun 03 15:10:02.230388 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.230346 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c"] Jun 03 15:10:02.235007 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.234979 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:02.240017 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.239989 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 15:10:02.240017 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.240004 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lvthc\"" Jun 03 15:10:02.248172 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.248125 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c"] Jun 03 15:10:02.321708 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.321666 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cjm\" (UniqueName: \"kubernetes.io/projected/9658ee07-4408-4b7b-b5d8-053ed9a4f179-kube-api-access-h5cjm\") pod \"dns-operator-controller-manager-648d5c98bc-dwm7c\" (UID: \"9658ee07-4408-4b7b-b5d8-053ed9a4f179\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:02.422548 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.422510 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cjm\" (UniqueName: \"kubernetes.io/projected/9658ee07-4408-4b7b-b5d8-053ed9a4f179-kube-api-access-h5cjm\") pod \"dns-operator-controller-manager-648d5c98bc-dwm7c\" (UID: \"9658ee07-4408-4b7b-b5d8-053ed9a4f179\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:02.433999 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.433962 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cjm\" (UniqueName: \"kubernetes.io/projected/9658ee07-4408-4b7b-b5d8-053ed9a4f179-kube-api-access-h5cjm\") pod \"dns-operator-controller-manager-648d5c98bc-dwm7c\" (UID: \"9658ee07-4408-4b7b-b5d8-053ed9a4f179\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:02.546024 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.545932 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:02.687814 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:02.687777 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c"] Jun 03 15:10:02.689390 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:10:02.689364 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9658ee07_4408_4b7b_b5d8_053ed9a4f179.slice/crio-28768b28e34835948fb03553ebd36a6d34dfdd8aecc55fa5bffb266917e1bcb1 WatchSource:0}: Error finding container 28768b28e34835948fb03553ebd36a6d34dfdd8aecc55fa5bffb266917e1bcb1: Status 404 returned error can't find the container with id 28768b28e34835948fb03553ebd36a6d34dfdd8aecc55fa5bffb266917e1bcb1 Jun 03 15:10:03.096249 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:03.096211 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" event={"ID":"9658ee07-4408-4b7b-b5d8-053ed9a4f179","Type":"ContainerStarted","Data":"28768b28e34835948fb03553ebd36a6d34dfdd8aecc55fa5bffb266917e1bcb1"} Jun 03 15:10:05.113014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:05.112921 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" event={"ID":"9658ee07-4408-4b7b-b5d8-053ed9a4f179","Type":"ContainerStarted","Data":"ba7d20820e9926d6b39d04e6fd1ed0e7e525c432579735dd18556f78fbaaf290"} Jun 03 15:10:05.113014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:05.112983 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:10:05.176669 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:05.176618 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" podStartSLOduration=1.152933061 podStartE2EDuration="3.176601294s" podCreationTimestamp="2026-06-03 15:10:02 +0000 UTC" firstStartedPulling="2026-06-03 15:10:02.691339125 +0000 UTC m=+382.824628004" lastFinishedPulling="2026-06-03 15:10:04.715007357 +0000 UTC m=+384.848296237" observedRunningTime="2026-06-03 15:10:05.172185906 +0000 UTC m=+385.305474806" watchObservedRunningTime="2026-06-03 15:10:05.176601294 +0000 UTC m=+385.309890194" Jun 03 15:10:08.078370 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:08.078338 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-bnqb8" Jun 03 15:10:16.120494 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:10:16.120454 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dwm7c" Jun 03 15:11:05.719614 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.719578 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:11:05.722992 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.722972 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:05.727543 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.727514 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8kb7\"" Jun 03 15:11:05.728949 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.728931 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 15:11:05.761586 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.761547 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:11:05.827712 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.827668 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:11:05.918237 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.918197 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-config-file\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:05.918453 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:05.918249 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rkb\" (UniqueName: \"kubernetes.io/projected/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-kube-api-access-s6rkb\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.019652 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.019536 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-config-file\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.019652 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.019582 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rkb\" (UniqueName: \"kubernetes.io/projected/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-kube-api-access-s6rkb\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.020342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.020319 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-config-file\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.031723 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.031690 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rkb\" (UniqueName: \"kubernetes.io/projected/7fde09a9-7966-4a7a-849a-a6c52a3bbad2-kube-api-access-s6rkb\") pod \"limitador-limitador-78c99df468-rspcv\" (UID: \"7fde09a9-7966-4a7a-849a-a6c52a3bbad2\") " pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.034350 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.034323 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:06.200267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.200235 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:11:06.201703 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:11:06.201672 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fde09a9_7966_4a7a_849a_a6c52a3bbad2.slice/crio-ca5b26a3097af1062300996359281e0181c419ab2891aae703e8576b43f6d92c WatchSource:0}: Error finding container ca5b26a3097af1062300996359281e0181c419ab2891aae703e8576b43f6d92c: Status 404 returned error can't find the container with id ca5b26a3097af1062300996359281e0181c419ab2891aae703e8576b43f6d92c Jun 03 15:11:06.358488 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:06.358391 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" event={"ID":"7fde09a9-7966-4a7a-849a-a6c52a3bbad2","Type":"ContainerStarted","Data":"ca5b26a3097af1062300996359281e0181c419ab2891aae703e8576b43f6d92c"} Jun 03 15:11:09.376052 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:09.376013 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" event={"ID":"7fde09a9-7966-4a7a-849a-a6c52a3bbad2","Type":"ContainerStarted","Data":"a96d8940fd9c4eec6246b350a1d55861e0c07ee65648e18432c68161fab620e0"} Jun 03 15:11:09.376561 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:09.376080 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:09.410282 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:09.410221 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" podStartSLOduration=1.84968859 podStartE2EDuration="4.410204064s" podCreationTimestamp="2026-06-03 15:11:05 +0000 UTC" firstStartedPulling="2026-06-03 15:11:06.203719355 +0000 UTC m=+446.337008234" lastFinishedPulling="2026-06-03 15:11:08.764234828 +0000 UTC m=+448.897523708" observedRunningTime="2026-06-03 15:11:09.408344612 +0000 UTC m=+449.541633512" watchObservedRunningTime="2026-06-03 15:11:09.410204064 +0000 UTC m=+449.543492976" Jun 03 15:11:20.382011 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:20.381970 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-rspcv" Jun 03 15:11:39.780034 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.780000 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh"] Jun 03 15:11:39.783837 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.783814 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:39.790267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.790236 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:11:39.790445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.790408 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lvglt\"" Jun 03 15:11:39.790445 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.790408 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:11:39.797836 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.797796 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh"] Jun 03 15:11:39.963513 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.963461 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv2qn\" (UniqueName: \"kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:39.963513 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.963508 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:39.963744 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:39.963541 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.064193 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.064052 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fv2qn\" (UniqueName: \"kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.064193 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.064106 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.064193 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.064167 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.064583 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.064560 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.064654 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.064597 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.077064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.077026 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv2qn\" (UniqueName: \"kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.093918 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.093879 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:40.250988 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.250951 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh"] Jun 03 15:11:40.252441 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:11:40.252412 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1170c5_e778_4881_97e9_c1ddfa59e423.slice/crio-ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27 WatchSource:0}: Error finding container ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27: Status 404 returned error can't find the container with id ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27 Jun 03 15:11:40.503079 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.503027 2527 generic.go:358] "Generic (PLEG): container finished" podID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerID="f4912c1b8d96bec4b3ed510f62ea98e2797bfb00c648341b1434b79df61fc4c8" exitCode=0 Jun 03 15:11:40.503274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.503117 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" event={"ID":"9f1170c5-e778-4881-97e9-c1ddfa59e423","Type":"ContainerDied","Data":"f4912c1b8d96bec4b3ed510f62ea98e2797bfb00c648341b1434b79df61fc4c8"} Jun 03 15:11:40.503274 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:40.503182 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" event={"ID":"9f1170c5-e778-4881-97e9-c1ddfa59e423","Type":"ContainerStarted","Data":"ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27"} Jun 03 15:11:41.509196 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:41.509154 2527 generic.go:358] "Generic (PLEG): container finished" podID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerID="5957145e0cfaf1b24e6080359fb7812bf5b67ec287c407a89c02bc3a082ad73b" exitCode=0 Jun 03 15:11:41.509196 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:41.509174 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" event={"ID":"9f1170c5-e778-4881-97e9-c1ddfa59e423","Type":"ContainerDied","Data":"5957145e0cfaf1b24e6080359fb7812bf5b67ec287c407a89c02bc3a082ad73b"} Jun 03 15:11:42.515466 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:42.515423 2527 generic.go:358] "Generic (PLEG): container finished" podID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerID="c78bb30eff46f1e1796d6ece8b39160ca6f4a10fd18d55f648d073d32644d022" exitCode=0 Jun 03 15:11:42.515880 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:42.515518 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" event={"ID":"9f1170c5-e778-4881-97e9-c1ddfa59e423","Type":"ContainerDied","Data":"c78bb30eff46f1e1796d6ece8b39160ca6f4a10fd18d55f648d073d32644d022"} Jun 03 15:11:43.664406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.664378 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:11:43.693204 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.693163 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle\") pod \"9f1170c5-e778-4881-97e9-c1ddfa59e423\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " Jun 03 15:11:43.693420 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.693234 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util\") pod \"9f1170c5-e778-4881-97e9-c1ddfa59e423\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " Jun 03 15:11:43.693696 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.693671 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle" (OuterVolumeSpecName: "bundle") pod "9f1170c5-e778-4881-97e9-c1ddfa59e423" (UID: "9f1170c5-e778-4881-97e9-c1ddfa59e423"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:11:43.701379 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.701336 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util" (OuterVolumeSpecName: "util") pod "9f1170c5-e778-4881-97e9-c1ddfa59e423" (UID: "9f1170c5-e778-4881-97e9-c1ddfa59e423"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:11:43.794388 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.794286 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv2qn\" (UniqueName: \"kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn\") pod \"9f1170c5-e778-4881-97e9-c1ddfa59e423\" (UID: \"9f1170c5-e778-4881-97e9-c1ddfa59e423\") " Jun 03 15:11:43.794579 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.794561 2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:11:43.794639 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.794586 2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f1170c5-e778-4881-97e9-c1ddfa59e423-util\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:11:43.796518 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.796493 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn" (OuterVolumeSpecName: "kube-api-access-fv2qn") pod "9f1170c5-e778-4881-97e9-c1ddfa59e423" (UID: "9f1170c5-e778-4881-97e9-c1ddfa59e423"). InnerVolumeSpecName "kube-api-access-fv2qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:11:43.895098 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:43.895051 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv2qn\" (UniqueName: \"kubernetes.io/projected/9f1170c5-e778-4881-97e9-c1ddfa59e423-kube-api-access-fv2qn\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:11:44.526056 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:44.526023 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" event={"ID":"9f1170c5-e778-4881-97e9-c1ddfa59e423","Type":"ContainerDied","Data":"ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27"} Jun 03 15:11:44.526056 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:44.526061 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebb6fed0c77b311692717c996eb424012aa92dc634680f1b02d619e16c2e6c27" Jun 03 15:11:44.526293 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:11:44.526027 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70zjbdh" Jun 03 15:12:04.601866 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.601830 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602244 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="pull" Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602257 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="pull" Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602266 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="extract" Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602272 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="extract" Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602291 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="util" Jun 03 15:12:04.602323 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602298 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="util" Jun 03 15:12:04.602508 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.602388 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f1170c5-e778-4881-97e9-c1ddfa59e423" containerName="extract" Jun 03 15:12:04.605570 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.605541 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:04.611078 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.611038 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:12:04.611272 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.611082 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 15:12:04.611272 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.611087 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:12:04.612795 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.612614 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qlfrx\"" Jun 03 15:12:04.618477 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.618443 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:12:04.691704 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.691655 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcsb6\" (UniqueName: \"kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6\") pod \"maas-keycloak-0\" (UID: \"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:04.793065 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.793018 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcsb6\" (UniqueName: \"kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6\") pod \"maas-keycloak-0\" (UID: \"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:04.804757 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.804723 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcsb6\" (UniqueName: \"kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6\") pod \"maas-keycloak-0\" (UID: \"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:04.916267 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:04.916123 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:05.080064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:05.079997 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:12:05.081199 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:12:05.081167 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4a0af9_18f9_48dd_a21c_3478e30ad1ad.slice/crio-e9e37656e9bfa0aa79cf2ab73d23323f35ce61ac2d9f7333cba31e1e28dc3791 WatchSource:0}: Error finding container e9e37656e9bfa0aa79cf2ab73d23323f35ce61ac2d9f7333cba31e1e28dc3791: Status 404 returned error can't find the container with id e9e37656e9bfa0aa79cf2ab73d23323f35ce61ac2d9f7333cba31e1e28dc3791 Jun 03 15:12:05.614145 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:05.614077 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad","Type":"ContainerStarted","Data":"e9e37656e9bfa0aa79cf2ab73d23323f35ce61ac2d9f7333cba31e1e28dc3791"} Jun 03 15:12:10.641582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:10.641539 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad","Type":"ContainerStarted","Data":"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6"} Jun 03 15:12:10.665365 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:10.665302 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.166102261 podStartE2EDuration="6.665284779s" podCreationTimestamp="2026-06-03 15:12:04 +0000 UTC" firstStartedPulling="2026-06-03 15:12:05.08263806 +0000 UTC m=+505.215926939" lastFinishedPulling="2026-06-03 15:12:09.581820574 +0000 UTC m=+509.715109457" observedRunningTime="2026-06-03 15:12:10.664085408 +0000 UTC m=+510.797374310" watchObservedRunningTime="2026-06-03 15:12:10.665284779 +0000 UTC m=+510.798573679" Jun 03 15:12:10.916857 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:10.916727 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:10.918454 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:10.918407 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:11.916876 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:11.916817 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:12.917263 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:12.917202 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:13.917717 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:13.917652 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:14.916556 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:14.916507 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:14.917405 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:14.916908 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:15.916885 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:15.916834 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:16.917153 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:16.917078 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:17.916850 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:17.916794 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:18.917718 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:18.917646 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:19.916985 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:19.916931 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:20.917250 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:20.917188 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:21.916795 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:21.916741 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:22.917618 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:22.917569 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 03 15:12:24.042161 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:24.042108 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 15:12:24.058852 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:24.058786 2527 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:12:34.048647 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:12:34.048606 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:15.258048 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:15.258004 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:13:27.071447 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:27.071404 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:27.071925 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:27.071676 2527 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" containerID="cri-o://006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6" gracePeriod=30 Jun 03 15:13:28.726684 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:28.726658 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:28.733312 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:28.733283 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcsb6\" (UniqueName: \"kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6\") pod \"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad\" (UID: \"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad\") " Jun 03 15:13:28.735561 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:28.735533 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6" (OuterVolumeSpecName: "kube-api-access-fcsb6") pod "aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" (UID: "aa4a0af9-18f9-48dd-a21c-3478e30ad1ad"). InnerVolumeSpecName "kube-api-access-fcsb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:13:28.834484 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:28.834434 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcsb6\" (UniqueName: \"kubernetes.io/projected/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad-kube-api-access-fcsb6\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:13:29.007474 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.007377 2527 generic.go:358] "Generic (PLEG): container finished" podID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerID="006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6" exitCode=143 Jun 03 15:13:29.007474 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.007444 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.007474 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.007460 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad","Type":"ContainerDied","Data":"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6"} Jun 03 15:13:29.007719 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.007503 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aa4a0af9-18f9-48dd-a21c-3478e30ad1ad","Type":"ContainerDied","Data":"e9e37656e9bfa0aa79cf2ab73d23323f35ce61ac2d9f7333cba31e1e28dc3791"} Jun 03 15:13:29.007719 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.007520 2527 scope.go:117] "RemoveContainer" containerID="006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6" Jun 03 15:13:29.020716 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.020682 2527 scope.go:117] "RemoveContainer" containerID="006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6" Jun 03 15:13:29.021218 ip-10-0-133-25 kubenswrapper[2527]: E0603 15:13:29.021196 2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6\": container with ID starting with 006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6 not found: ID does not exist" containerID="006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6" Jun 03 15:13:29.021296 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.021236 2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6"} err="failed to get container status \"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6\": rpc error: code = NotFound desc = could not find container \"006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6\": container with ID starting with 006a3eaa0d88daf9240a2b6d1d3b98cbc8937783031c02c9ecb3d5285b5bd3a6 not found: ID does not exist" Jun 03 15:13:29.032905 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.032869 2527 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:29.036512 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.036480 2527 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:29.059317 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.059279 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:29.059687 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.059674 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" Jun 03 15:13:29.059739 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.059689 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" Jun 03 15:13:29.059780 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.059748 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" containerName="keycloak" Jun 03 15:13:29.062520 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.062501 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.065838 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.065809 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qlfrx\"" Jun 03 15:13:29.065838 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.065837 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 15:13:29.066020 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.065809 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:13:29.066240 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.066224 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:13:29.066280 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.066227 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 15:13:29.080070 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.074121 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:29.136426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.136382 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8f296c42-7c2a-4091-b1d3-dd2e0f241888-test-realms\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.136602 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.136507 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqbwm\" (UniqueName: \"kubernetes.io/projected/8f296c42-7c2a-4091-b1d3-dd2e0f241888-kube-api-access-mqbwm\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.237215 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.237175 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqbwm\" (UniqueName: \"kubernetes.io/projected/8f296c42-7c2a-4091-b1d3-dd2e0f241888-kube-api-access-mqbwm\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.237417 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.237287 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8f296c42-7c2a-4091-b1d3-dd2e0f241888-test-realms\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.237961 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.237939 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8f296c42-7c2a-4091-b1d3-dd2e0f241888-test-realms\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.247698 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.247669 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqbwm\" (UniqueName: \"kubernetes.io/projected/8f296c42-7c2a-4091-b1d3-dd2e0f241888-kube-api-access-mqbwm\") pod \"maas-keycloak-0\" (UID: \"8f296c42-7c2a-4091-b1d3-dd2e0f241888\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.374018 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.373903 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:29.520806 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:29.520775 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:13:29.522476 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:13:29.522428 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f296c42_7c2a_4091_b1d3_dd2e0f241888.slice/crio-a1308f72e5dc4de4bfb31daf40fa378341993d0e14c299a44df6414339c7335e WatchSource:0}: Error finding container a1308f72e5dc4de4bfb31daf40fa378341993d0e14c299a44df6414339c7335e: Status 404 returned error can't find the container with id a1308f72e5dc4de4bfb31daf40fa378341993d0e14c299a44df6414339c7335e Jun 03 15:13:30.015269 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.015230 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8f296c42-7c2a-4091-b1d3-dd2e0f241888","Type":"ContainerStarted","Data":"9cef15cde167a1610aab57af41ed65950f61db7108b143eaae97ec640116b520"} Jun 03 15:13:30.015269 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.015271 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8f296c42-7c2a-4091-b1d3-dd2e0f241888","Type":"ContainerStarted","Data":"a1308f72e5dc4de4bfb31daf40fa378341993d0e14c299a44df6414339c7335e"} Jun 03 15:13:30.037239 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.037172 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.667972203 podStartE2EDuration="1.037152933s" podCreationTimestamp="2026-06-03 15:13:29 +0000 UTC" firstStartedPulling="2026-06-03 15:13:29.523785358 +0000 UTC m=+589.657074236" lastFinishedPulling="2026-06-03 15:13:29.892966088 +0000 UTC m=+590.026254966" observedRunningTime="2026-06-03 15:13:30.035910928 +0000 UTC m=+590.169199829" watchObservedRunningTime="2026-06-03 15:13:30.037152933 +0000 UTC m=+590.170441838" Jun 03 15:13:30.374821 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.374776 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:30.376746 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.376700 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:30.547879 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:30.547842 2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4a0af9-18f9-48dd-a21c-3478e30ad1ad" path="/var/lib/kubelet/pods/aa4a0af9-18f9-48dd-a21c-3478e30ad1ad/volumes" Jun 03 15:13:31.375189 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:31.375114 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:32.375168 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:32.375095 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:33.374631 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:33.374567 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:34.374949 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:34.374897 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:35.374934 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:35.374870 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:36.374901 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:36.374840 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:37.375255 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:37.375199 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:38.375038 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:38.374979 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:39.374951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:39.374898 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:39.375468 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:39.375251 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:40.374853 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:40.374806 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:41.374775 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:41.374709 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:42.375185 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:42.375109 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:43.374815 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:43.374770 2527 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused" Jun 03 15:13:44.487254 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:44.487204 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 15:13:44.505238 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:44.505185 2527 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:13:54.492810 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:13:54.492748 2527 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8f296c42-7c2a-4091-b1d3-dd2e0f241888" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:14:04.494101 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:04.494052 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:14:41.676149 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.676094 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv"] Jun 03 15:14:41.679052 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.679024 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.684079 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.684051 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 15:14:41.684079 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.684069 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 15:14:41.684339 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.684051 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n8whh\"" Jun 03 15:14:41.684339 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.684112 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 15:14:41.689159 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.689107 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv"] Jun 03 15:14:41.840699 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840656 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvdh\" (UniqueName: \"kubernetes.io/projected/183f3c34-18de-4652-8e1f-339268f7bc75-kube-api-access-7hvdh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.840947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840723 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/183f3c34-18de-4652-8e1f-339268f7bc75-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.840947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840800 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.840947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840872 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.840947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840908 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.840947 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.840939 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942385 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942287 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvdh\" (UniqueName: \"kubernetes.io/projected/183f3c34-18de-4652-8e1f-339268f7bc75-kube-api-access-7hvdh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942385 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942344 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/183f3c34-18de-4652-8e1f-339268f7bc75-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942385 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942369 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942672 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942398 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942672 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942427 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942672 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942457 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.942896 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942865 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.943047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942899 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.943047 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.942998 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.944861 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.944839 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/183f3c34-18de-4652-8e1f-339268f7bc75-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.945342 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.945320 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/183f3c34-18de-4652-8e1f-339268f7bc75-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.951313 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.951286 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvdh\" (UniqueName: \"kubernetes.io/projected/183f3c34-18de-4652-8e1f-339268f7bc75-kube-api-access-7hvdh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv\" (UID: \"183f3c34-18de-4652-8e1f-339268f7bc75\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:41.992426 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:41.992379 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:14:42.092784 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:42.092748 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:14:42.145526 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:42.145501 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv"] Jun 03 15:14:42.147384 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:14:42.147344 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183f3c34_18de_4652_8e1f_339268f7bc75.slice/crio-6c18f36d9059667643ec75dc408bb9333a731ea58dd130c79334938e718232b2 WatchSource:0}: Error finding container 6c18f36d9059667643ec75dc408bb9333a731ea58dd130c79334938e718232b2: Status 404 returned error can't find the container with id 6c18f36d9059667643ec75dc408bb9333a731ea58dd130c79334938e718232b2 Jun 03 15:14:42.149184 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:42.149163 2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:14:42.362075 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:42.362029 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" event={"ID":"183f3c34-18de-4652-8e1f-339268f7bc75","Type":"ContainerStarted","Data":"6c18f36d9059667643ec75dc408bb9333a731ea58dd130c79334938e718232b2"} Jun 03 15:14:47.389882 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:47.389780 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" event={"ID":"183f3c34-18de-4652-8e1f-339268f7bc75","Type":"ContainerStarted","Data":"c489882b3aefd7471a0f8497b70ddcd3e5ec70454d3783a32ca0ef45b4dc9624"} Jun 03 15:14:50.407658 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:50.407621 2527 generic.go:358] "Generic (PLEG): container finished" podID="183f3c34-18de-4652-8e1f-339268f7bc75" containerID="c489882b3aefd7471a0f8497b70ddcd3e5ec70454d3783a32ca0ef45b4dc9624" exitCode=0 Jun 03 15:14:50.408084 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:50.407700 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" event={"ID":"183f3c34-18de-4652-8e1f-339268f7bc75","Type":"ContainerDied","Data":"c489882b3aefd7471a0f8497b70ddcd3e5ec70454d3783a32ca0ef45b4dc9624"} Jun 03 15:14:51.794582 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.794547 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs"] Jun 03 15:14:51.797569 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.797545 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.803156 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.803104 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 15:14:51.813084 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.813041 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs"] Jun 03 15:14:51.841383 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841349 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.841552 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841389 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.841552 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841510 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.841552 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841543 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4tpp\" (UniqueName: \"kubernetes.io/projected/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kube-api-access-h4tpp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.841714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841606 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.841714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.841664 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.942950 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.942908 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.942950 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.942951 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.942997 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943015 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4tpp\" (UniqueName: \"kubernetes.io/projected/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kube-api-access-h4tpp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943073 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943361 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943161 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943414 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943455 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.943574 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.943496 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.945508 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.945482 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.945782 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.945758 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:51.952954 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:51.952925 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4tpp\" (UniqueName: \"kubernetes.io/projected/2e38c8e8-92e3-4f65-b7a2-aed60f27761c-kube-api-access-h4tpp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs\" (UID: \"2e38c8e8-92e3-4f65-b7a2-aed60f27761c\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:52.108483 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.108380 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:14:52.257549 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.257520 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs"] Jun 03 15:14:52.259215 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:14:52.259176 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e38c8e8_92e3_4f65_b7a2_aed60f27761c.slice/crio-9b065e385a8f89ee4b6f5ac9a318df530f717e0436876fc2160e06b2160f93a2 WatchSource:0}: Error finding container 9b065e385a8f89ee4b6f5ac9a318df530f717e0436876fc2160e06b2160f93a2: Status 404 returned error can't find the container with id 9b065e385a8f89ee4b6f5ac9a318df530f717e0436876fc2160e06b2160f93a2 Jun 03 15:14:52.392014 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.391911 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:14:52.418613 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.418568 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" event={"ID":"183f3c34-18de-4652-8e1f-339268f7bc75","Type":"ContainerStarted","Data":"979409f503f202b5aa91edceffdc4af7bc156c3464fb5be93a49e163490d0d03"} Jun 03 15:14:52.420465 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.420432 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" event={"ID":"2e38c8e8-92e3-4f65-b7a2-aed60f27761c","Type":"ContainerStarted","Data":"c39ce36629d705bfbfbdc22cec9c28ab7cae6865a077c899a8abe0fb8a048910"} Jun 03 15:14:52.420614 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.420469 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" event={"ID":"2e38c8e8-92e3-4f65-b7a2-aed60f27761c","Type":"ContainerStarted","Data":"9b065e385a8f89ee4b6f5ac9a318df530f717e0436876fc2160e06b2160f93a2"} Jun 03 15:14:52.441660 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:52.441603 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" podStartSLOduration=1.7600048689999999 podStartE2EDuration="11.441585666s" podCreationTimestamp="2026-06-03 15:14:41 +0000 UTC" firstStartedPulling="2026-06-03 15:14:42.149331831 +0000 UTC m=+662.282620710" lastFinishedPulling="2026-06-03 15:14:51.830912627 +0000 UTC m=+671.964201507" observedRunningTime="2026-06-03 15:14:52.439083313 +0000 UTC m=+672.572372216" watchObservedRunningTime="2026-06-03 15:14:52.441585666 +0000 UTC m=+672.574874566" Jun 03 15:14:58.447911 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:58.447872 2527 generic.go:358] "Generic (PLEG): container finished" podID="2e38c8e8-92e3-4f65-b7a2-aed60f27761c" containerID="c39ce36629d705bfbfbdc22cec9c28ab7cae6865a077c899a8abe0fb8a048910" exitCode=0 Jun 03 15:14:58.448501 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:58.447945 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" event={"ID":"2e38c8e8-92e3-4f65-b7a2-aed60f27761c","Type":"ContainerDied","Data":"c39ce36629d705bfbfbdc22cec9c28ab7cae6865a077c899a8abe0fb8a048910"} Jun 03 15:14:59.454469 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:59.454427 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" event={"ID":"2e38c8e8-92e3-4f65-b7a2-aed60f27761c","Type":"ContainerStarted","Data":"fb2d2dcf6fa9cb81dae132333809a54c641c6853a6844a9eb9163a12957f951d"} Jun 03 15:14:59.478930 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:14:59.478861 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" podStartSLOduration=8.148739408 podStartE2EDuration="8.47884207s" podCreationTimestamp="2026-06-03 15:14:51 +0000 UTC" firstStartedPulling="2026-06-03 15:14:58.448805092 +0000 UTC m=+678.582093971" lastFinishedPulling="2026-06-03 15:14:58.778907741 +0000 UTC m=+678.912196633" observedRunningTime="2026-06-03 15:14:59.475512226 +0000 UTC m=+679.608801140" watchObservedRunningTime="2026-06-03 15:14:59.47884207 +0000 UTC m=+679.612130973" Jun 03 15:15:00.139502 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.139455 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674995-cmjpn"] Jun 03 15:15:00.142334 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.142310 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:00.145543 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.145508 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wcpvc\"" Jun 03 15:15:00.151687 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.151664 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674995-cmjpn"] Jun 03 15:15:00.226821 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.226775 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxnjl\" (UniqueName: \"kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl\") pod \"maas-api-key-cleanup-29674995-cmjpn\" (UID: \"d653db19-5b63-485d-b3d3-30fe122de94f\") " pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:00.328197 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.328113 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnjl\" (UniqueName: \"kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl\") pod \"maas-api-key-cleanup-29674995-cmjpn\" (UID: \"d653db19-5b63-485d-b3d3-30fe122de94f\") " pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:00.337689 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.337654 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnjl\" (UniqueName: \"kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl\") pod \"maas-api-key-cleanup-29674995-cmjpn\" (UID: \"d653db19-5b63-485d-b3d3-30fe122de94f\") " pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:00.455203 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.455159 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:00.612743 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:00.612716 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674995-cmjpn"] Jun 03 15:15:00.614436 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:15:00.614400 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd653db19_5b63_485d_b3d3_30fe122de94f.slice/crio-fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3 WatchSource:0}: Error finding container fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3: Status 404 returned error can't find the container with id fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3 Jun 03 15:15:01.472572 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:01.472530 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" event={"ID":"d653db19-5b63-485d-b3d3-30fe122de94f","Type":"ContainerStarted","Data":"fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3"} Jun 03 15:15:01.993277 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:01.993229 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:15:01.993277 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:01.993280 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:15:02.007172 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.007113 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:15:02.109207 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.109164 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:15:02.109207 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.109210 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:15:02.125111 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.125075 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:15:02.490682 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.490637 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs" Jun 03 15:15:02.495760 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:02.495730 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv" Jun 03 15:15:03.483486 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:03.483382 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" event={"ID":"d653db19-5b63-485d-b3d3-30fe122de94f","Type":"ContainerStarted","Data":"523a48f4985b4d4a33e02e049c196815f2bd0719d9855fb9cb26717dd36cdd94"} Jun 03 15:15:03.514371 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:03.514314 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" podStartSLOduration=1.22862684 podStartE2EDuration="3.514293075s" podCreationTimestamp="2026-06-03 15:15:00 +0000 UTC" firstStartedPulling="2026-06-03 15:15:00.616479639 +0000 UTC m=+680.749768521" lastFinishedPulling="2026-06-03 15:15:02.902145877 +0000 UTC m=+683.035434756" observedRunningTime="2026-06-03 15:15:03.511570674 +0000 UTC m=+683.644859587" watchObservedRunningTime="2026-06-03 15:15:03.514293075 +0000 UTC m=+683.647581975" Jun 03 15:15:04.489462 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:04.489422 2527 generic.go:358] "Generic (PLEG): container finished" podID="d653db19-5b63-485d-b3d3-30fe122de94f" containerID="523a48f4985b4d4a33e02e049c196815f2bd0719d9855fb9cb26717dd36cdd94" exitCode=0 Jun 03 15:15:04.489657 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:04.489516 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" event={"ID":"d653db19-5b63-485d-b3d3-30fe122de94f","Type":"ContainerDied","Data":"523a48f4985b4d4a33e02e049c196815f2bd0719d9855fb9cb26717dd36cdd94"} Jun 03 15:15:04.700965 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:04.700923 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:15:05.643579 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:05.643549 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:05.679292 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:05.679259 2527 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxnjl\" (UniqueName: \"kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl\") pod \"d653db19-5b63-485d-b3d3-30fe122de94f\" (UID: \"d653db19-5b63-485d-b3d3-30fe122de94f\") " Jun 03 15:15:05.681748 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:05.681697 2527 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl" (OuterVolumeSpecName: "kube-api-access-lxnjl") pod "d653db19-5b63-485d-b3d3-30fe122de94f" (UID: "d653db19-5b63-485d-b3d3-30fe122de94f"). InnerVolumeSpecName "kube-api-access-lxnjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:15:05.780384 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:05.780285 2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxnjl\" (UniqueName: \"kubernetes.io/projected/d653db19-5b63-485d-b3d3-30fe122de94f-kube-api-access-lxnjl\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Jun 03 15:15:06.499027 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:06.498995 2527 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" Jun 03 15:15:06.499027 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:06.499010 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674995-cmjpn" event={"ID":"d653db19-5b63-485d-b3d3-30fe122de94f","Type":"ContainerDied","Data":"fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3"} Jun 03 15:15:06.499298 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:06.499055 2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fded524e6a2e7bed079e2d95dac3527aa8e2ecd1606f180b3753e2480a357cd3" Jun 03 15:15:12.398965 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:12.398923 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:15:33.396321 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.396282 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm"] Jun 03 15:15:33.396807 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.396698 2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d653db19-5b63-485d-b3d3-30fe122de94f" containerName="cleanup" Jun 03 15:15:33.396807 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.396711 2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="d653db19-5b63-485d-b3d3-30fe122de94f" containerName="cleanup" Jun 03 15:15:33.396807 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.396773 2527 memory_manager.go:356] "RemoveStaleState removing state" podUID="d653db19-5b63-485d-b3d3-30fe122de94f" containerName="cleanup" Jun 03 15:15:33.399067 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.399048 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.402680 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.402658 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 15:15:33.413326 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.413296 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm"] Jun 03 15:15:33.446056 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446006 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjpz\" (UniqueName: \"kubernetes.io/projected/6bcc026e-462d-4614-8399-5eec017196d1-kube-api-access-6vjpz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.446335 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446204 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc026e-462d-4614-8399-5eec017196d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.446488 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446350 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.446488 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446459 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.446578 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446500 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.446621 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.446587 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547051 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547000 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547051 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547051 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjpz\" (UniqueName: \"kubernetes.io/projected/6bcc026e-462d-4614-8399-5eec017196d1-kube-api-access-6vjpz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547099 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc026e-462d-4614-8399-5eec017196d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547124 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547201 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547343 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547238 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547580 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547547 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547626 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547572 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.547626 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.547598 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.549751 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.549725 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc026e-462d-4614-8399-5eec017196d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.550200 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.550173 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc026e-462d-4614-8399-5eec017196d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.555922 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.555896 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjpz\" (UniqueName: \"kubernetes.io/projected/6bcc026e-462d-4614-8399-5eec017196d1-kube-api-access-6vjpz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm\" (UID: \"6bcc026e-462d-4614-8399-5eec017196d1\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.711099 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.711051 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:33.862871 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:33.862834 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm"] Jun 03 15:15:33.864884 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:15:33.864853 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcc026e_462d_4614_8399_5eec017196d1.slice/crio-07666df913bba414a826737fc78cf4a83dc594573d910230eb39cd4b258af80b WatchSource:0}: Error finding container 07666df913bba414a826737fc78cf4a83dc594573d910230eb39cd4b258af80b: Status 404 returned error can't find the container with id 07666df913bba414a826737fc78cf4a83dc594573d910230eb39cd4b258af80b Jun 03 15:15:34.627790 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:34.627740 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" event={"ID":"6bcc026e-462d-4614-8399-5eec017196d1","Type":"ContainerStarted","Data":"d7b572c9b2efa5c1115d4cdf98e0833d4098e78acb0e421f40135a49129fbed0"} Jun 03 15:15:34.627790 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:34.627789 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" event={"ID":"6bcc026e-462d-4614-8399-5eec017196d1","Type":"ContainerStarted","Data":"07666df913bba414a826737fc78cf4a83dc594573d910230eb39cd4b258af80b"} Jun 03 15:15:34.795191 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:34.795147 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:15:37.643962 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:37.643906 2527 generic.go:358] "Generic (PLEG): container finished" podID="6bcc026e-462d-4614-8399-5eec017196d1" containerID="d7b572c9b2efa5c1115d4cdf98e0833d4098e78acb0e421f40135a49129fbed0" exitCode=0 Jun 03 15:15:37.644471 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:37.644116 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" event={"ID":"6bcc026e-462d-4614-8399-5eec017196d1","Type":"ContainerDied","Data":"d7b572c9b2efa5c1115d4cdf98e0833d4098e78acb0e421f40135a49129fbed0"} Jun 03 15:15:38.650661 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:38.650614 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" event={"ID":"6bcc026e-462d-4614-8399-5eec017196d1","Type":"ContainerStarted","Data":"dcae6f7efb91695d6492d33f6fc95ff71a7122b0a77305466be45a1206cd196c"} Jun 03 15:15:38.672618 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:38.672564 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" podStartSLOduration=5.3902765200000005 podStartE2EDuration="5.672545627s" podCreationTimestamp="2026-06-03 15:15:33 +0000 UTC" firstStartedPulling="2026-06-03 15:15:37.645199052 +0000 UTC m=+717.778487930" lastFinishedPulling="2026-06-03 15:15:37.927468158 +0000 UTC m=+718.060757037" observedRunningTime="2026-06-03 15:15:38.671279254 +0000 UTC m=+718.804568171" watchObservedRunningTime="2026-06-03 15:15:38.672545627 +0000 UTC m=+718.805834592" Jun 03 15:15:43.711213 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:43.711157 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:43.711213 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:43.711211 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:43.723878 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:43.723841 2527 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:44.688420 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:44.688387 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm" Jun 03 15:15:51.089882 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:15:51.089844 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-rspcv"] Jun 03 15:21:45.622340 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:45.622302 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86b6644fd4-lwpcf_d7e14a46-ceb0-4a46-85ac-8411acb98aaf/nginx/0.log" Jun 03 15:21:45.862404 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:45.862377 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gvqj4_746a091a-6b49-4d6a-bb13-739ac387da73/manager/0.log" Jun 03 15:21:45.988604 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:45.988576 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-vl84w_cead805a-d731-4aba-9851-ea1f23b14a8a/manager/0.log" Jun 03 15:21:46.213340 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:46.213306 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674995-cmjpn_d653db19-5b63-485d-b3d3-30fe122de94f/cleanup/0.log" Jun 03 15:21:46.438272 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:46.438178 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-p8qb8_3d04ae84-31a8-49df-9486-a52b6a3fe8f3/server/0.log" Jun 03 15:21:46.563326 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:46.563296 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lvbks_9d28aad4-3db2-46b7-a48e-f9d085e0661a/manager/0.log" Jun 03 15:21:46.675006 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:46.674972 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-98tvs_dfeb9898-3fd8-40a3-aac0-d7b638264c69/copy-manifests/0.log" Jun 03 15:21:46.694406 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:46.694323 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-98tvs_dfeb9898-3fd8-40a3-aac0-d7b638264c69/manager/0.log" Jun 03 15:21:47.800116 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.800081 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/util/0.log" Jun 03 15:21:47.806291 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.806268 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/pull/0.log" Jun 03 15:21:47.811804 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.811778 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/extract/0.log" Jun 03 15:21:47.927399 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.927361 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/util/0.log" Jun 03 15:21:47.934250 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.934218 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/pull/0.log" Jun 03 15:21:47.940942 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:47.940913 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/extract/0.log" Jun 03 15:21:48.060764 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.060689 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/extract/0.log" Jun 03 15:21:48.068368 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.068347 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/util/0.log" Jun 03 15:21:48.075603 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.075583 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/pull/0.log" Jun 03 15:21:48.190999 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.190960 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/util/0.log" Jun 03 15:21:48.198391 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.198370 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/pull/0.log" Jun 03 15:21:48.205236 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.205215 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/extract/0.log" Jun 03 15:21:48.433628 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.433544 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-bnqb8_2b2aeb6b-0513-49fe-9535-abadf277422f/manager/0.log" Jun 03 15:21:48.540424 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.540398 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dwm7c_9658ee07-4408-4b7b-b5d8-053ed9a4f179/manager/0.log" Jun 03 15:21:48.768736 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.768705 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-88qvs_4e795459-c614-4bbd-a99b-cae043b27870/registry-server/0.log" Jun 03 15:21:48.992845 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:48.992812 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-rspcv_7fde09a9-7966-4a7a-849a-a6c52a3bbad2/limitador/0.log" Jun 03 15:21:49.587064 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:49.587025 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6llhw_52cd03f9-dedb-44c2-a757-605af05ae5bd/discovery/0.log" Jun 03 15:21:49.696854 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:49.696826 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d85c64844-msjbs_56deb6c1-002b-425d-8f6f-eb16801aeea3/kube-auth-proxy/0.log" Jun 03 15:21:50.484243 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.484214 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv_183f3c34-18de-4652-8e1f-339268f7bc75/storage-initializer/0.log" Jun 03 15:21:50.491416 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.491392 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-7fpjv_183f3c34-18de-4652-8e1f-339268f7bc75/main/0.log" Jun 03 15:21:50.604886 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.604856 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs_2e38c8e8-92e3-4f65-b7a2-aed60f27761c/storage-initializer/0.log" Jun 03 15:21:50.612447 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.612426 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-z4xvs_2e38c8e8-92e3-4f65-b7a2-aed60f27761c/main/0.log" Jun 03 15:21:50.973292 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.973263 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm_6bcc026e-462d-4614-8399-5eec017196d1/storage-initializer/0.log" Jun 03 15:21:50.980448 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:50.980420 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-ndjhm_6bcc026e-462d-4614-8399-5eec017196d1/main/0.log" Jun 03 15:21:58.771951 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:58.771919 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xs78h_835708ec-deaa-4306-a775-0fad9a810c7a/global-pull-secret-syncer/0.log" Jun 03 15:21:58.827061 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:58.827021 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f5mjl_b5f66339-fc2f-4525-bb62-d877f7b8e040/konnectivity-agent/0.log" Jun 03 15:21:58.970613 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:21:58.970578 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-25.ec2.internal_72b231887621a6db8e3ff733ed4d18b5/haproxy/0.log" Jun 03 15:22:02.920113 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:02.920077 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/extract/0.log" Jun 03 15:22:02.945105 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:02.945076 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/util/0.log" Jun 03 15:22:02.977590 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:02.977558 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596fssw_a96ef5cc-20eb-41b2-afbf-9e861be892a8/pull/0.log" Jun 03 15:22:03.017952 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.017924 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/extract/0.log" Jun 03 15:22:03.048115 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.048095 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/util/0.log" Jun 03 15:22:03.080908 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.080886 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h4dr8_de358631-1d8d-420e-b2bc-fed3e0e63afc/pull/0.log" Jun 03 15:22:03.119797 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.119776 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/extract/0.log" Jun 03 15:22:03.179319 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.179258 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/util/0.log" Jun 03 15:22:03.231990 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.231964 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t5rhh_8f3a0c98-1173-41da-ad83-c9e6f605ae1d/pull/0.log" Jun 03 15:22:03.278282 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.278247 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/extract/0.log" Jun 03 15:22:03.311661 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.311628 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/util/0.log" Jun 03 15:22:03.353923 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.353898 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5xxf_fbc46216-4f5f-4614-a16e-d6b138b4ffcf/pull/0.log" Jun 03 15:22:03.424446 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.424419 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-bnqb8_2b2aeb6b-0513-49fe-9535-abadf277422f/manager/0.log" Jun 03 15:22:03.455155 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.455111 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dwm7c_9658ee07-4408-4b7b-b5d8-053ed9a4f179/manager/0.log" Jun 03 15:22:03.530869 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.530842 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-88qvs_4e795459-c614-4bbd-a99b-cae043b27870/registry-server/0.log" Jun 03 15:22:03.700787 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:03.700761 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-rspcv_7fde09a9-7966-4a7a-849a-a6c52a3bbad2/limitador/0.log" Jun 03 15:22:05.167861 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.167833 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/alertmanager/0.log" Jun 03 15:22:05.200634 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.200604 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/config-reloader/0.log" Jun 03 15:22:05.225105 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.225070 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/kube-rbac-proxy-web/0.log" Jun 03 15:22:05.248724 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.248646 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/kube-rbac-proxy/0.log" Jun 03 15:22:05.273119 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.273092 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/kube-rbac-proxy-metric/0.log" Jun 03 15:22:05.294823 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.294798 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/prom-label-proxy/0.log" Jun 03 15:22:05.316527 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.316502 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2838c822-6b3e-43be-9726-9cb2ba952300/init-config-reloader/0.log" Jun 03 15:22:05.514126 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.514043 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bdf5d767f-vqd6z_d8ba560f-3851-41cc-a46f-75f3fc2ed34a/metrics-server/0.log" Jun 03 15:22:05.659571 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.659533 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh4vc_658c8eeb-cc18-48a6-a2ad-0bb802624c23/node-exporter/0.log" Jun 03 15:22:05.683518 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.683495 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh4vc_658c8eeb-cc18-48a6-a2ad-0bb802624c23/kube-rbac-proxy/0.log" Jun 03 15:22:05.708887 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:05.708866 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rh4vc_658c8eeb-cc18-48a6-a2ad-0bb802624c23/init-textfile/0.log" Jun 03 15:22:06.190488 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.190458 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558c55cf67-kfcvx_95ca318d-f1ff-49e9-aebc-a9b6b72d32d1/telemeter-client/0.log" Jun 03 15:22:06.214621 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.214593 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558c55cf67-kfcvx_95ca318d-f1ff-49e9-aebc-a9b6b72d32d1/reload/0.log" Jun 03 15:22:06.245179 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.245154 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558c55cf67-kfcvx_95ca318d-f1ff-49e9-aebc-a9b6b72d32d1/kube-rbac-proxy/0.log" Jun 03 15:22:06.277578 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.277534 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/thanos-query/0.log" Jun 03 15:22:06.297959 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.297936 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/kube-rbac-proxy-web/0.log" Jun 03 15:22:06.320212 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.320182 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/kube-rbac-proxy/0.log" Jun 03 15:22:06.341701 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.341672 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/prom-label-proxy/0.log" Jun 03 15:22:06.369175 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.369144 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/kube-rbac-proxy-rules/0.log" Jun 03 15:22:06.389854 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:06.389824 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db679d668-nh8bf_f516f271-9e62-412b-acff-04ecfe44b74f/kube-rbac-proxy-metrics/0.log" Jun 03 15:22:08.087266 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.087231 2527 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2"] Jun 03 15:22:08.090942 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.090918 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.094585 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.094565 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"kube-root-ca.crt\"" Jun 03 15:22:08.095238 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.095221 2527 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"openshift-service-ca.crt\"" Jun 03 15:22:08.096178 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.096163 2527 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7kqc\"/\"default-dockercfg-glhxv\"" Jun 03 15:22:08.101564 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.101541 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2"] Jun 03 15:22:08.226057 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.226021 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-proc\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.226260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.226065 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxfms\" (UniqueName: \"kubernetes.io/projected/a7ab3242-26ff-453a-8487-201e6ce3aca6-kube-api-access-cxfms\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.226260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.226121 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-podres\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.226260 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.226214 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-lib-modules\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.226402 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.226279 2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-sys\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327089 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327051 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-sys\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327116 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-proc\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327185 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxfms\" (UniqueName: \"kubernetes.io/projected/a7ab3242-26ff-453a-8487-201e6ce3aca6-kube-api-access-cxfms\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327210 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-podres\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327212 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-sys\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327229 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-proc\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327284 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327239 2527 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-lib-modules\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327526 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327345 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-podres\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.327526 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.327348 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7ab3242-26ff-453a-8487-201e6ce3aca6-lib-modules\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.337031 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.336997 2527 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxfms\" (UniqueName: \"kubernetes.io/projected/a7ab3242-26ff-453a-8487-201e6ce3aca6-kube-api-access-cxfms\") pod \"perf-node-gather-daemonset-xm6t2\" (UID: \"a7ab3242-26ff-453a-8487-201e6ce3aca6\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.401612 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.401531 2527 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:08.556950 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.556928 2527 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2"] Jun 03 15:22:08.559031 ip-10-0-133-25 kubenswrapper[2527]: W0603 15:22:08.559007 2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7ab3242_26ff_453a_8487_201e6ce3aca6.slice/crio-cef86a37d1474187a0ee30d132308bfd53be4cc06e6ff5641e91c0ca48d4b89c WatchSource:0}: Error finding container cef86a37d1474187a0ee30d132308bfd53be4cc06e6ff5641e91c0ca48d4b89c: Status 404 returned error can't find the container with id cef86a37d1474187a0ee30d132308bfd53be4cc06e6ff5641e91c0ca48d4b89c Jun 03 15:22:08.560679 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:08.560662 2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:22:09.281504 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:09.281468 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" event={"ID":"a7ab3242-26ff-453a-8487-201e6ce3aca6","Type":"ContainerStarted","Data":"b72fbcdcde4ee1a1f258c8abc88b32485c64ea262d331cb74ed0b391edb43a24"} Jun 03 15:22:09.281504 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:09.281506 2527 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" event={"ID":"a7ab3242-26ff-453a-8487-201e6ce3aca6","Type":"ContainerStarted","Data":"cef86a37d1474187a0ee30d132308bfd53be4cc06e6ff5641e91c0ca48d4b89c"} Jun 03 15:22:09.281920 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:09.281534 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:09.314030 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:09.313976 2527 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" podStartSLOduration=1.3139624429999999 podStartE2EDuration="1.313962443s" podCreationTimestamp="2026-06-03 15:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:22:09.310502321 +0000 UTC m=+1109.443791222" watchObservedRunningTime="2026-06-03 15:22:09.313962443 +0000 UTC m=+1109.447251344" Jun 03 15:22:10.127423 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:10.127372 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hnwr2_fcd72871-6d2f-4fc1-bb31-a9fe11b3d785/dns/0.log" Jun 03 15:22:10.150697 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:10.150672 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hnwr2_fcd72871-6d2f-4fc1-bb31-a9fe11b3d785/kube-rbac-proxy/0.log" Jun 03 15:22:10.223311 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:10.223273 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zmc8b_94a8d359-a6f4-4056-b3b3-d0cbc14ea666/dns-node-resolver/0.log" Jun 03 15:22:10.730663 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:10.730606 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b47f5b74b-gwcdz_b6532fba-d8d4-45fc-ac4f-4e434e486ba9/registry/0.log" Jun 03 15:22:10.790821 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:10.790777 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7g4xn_f17d30e5-ea52-4050-9f29-9a7fcdd036c7/node-ca/0.log" Jun 03 15:22:11.887217 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:11.887184 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6llhw_52cd03f9-dedb-44c2-a757-605af05ae5bd/discovery/0.log" Jun 03 15:22:11.911714 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:11.911679 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d85c64844-msjbs_56deb6c1-002b-425d-8f6f-eb16801aeea3/kube-auth-proxy/0.log" Jun 03 15:22:12.585227 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:12.585196 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ncp2g_3d363a17-8ed8-4831-8c0e-83cf2473018e/serve-healthcheck-canary/0.log" Jun 03 15:22:13.146374 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:13.146345 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dr6lc_64d29bc4-41e5-4d33-a634-7f4172ea76ea/kube-rbac-proxy/0.log" Jun 03 15:22:13.169187 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:13.169155 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dr6lc_64d29bc4-41e5-4d33-a634-7f4172ea76ea/exporter/0.log" Jun 03 15:22:13.189773 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:13.189725 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dr6lc_64d29bc4-41e5-4d33-a634-7f4172ea76ea/extractor/0.log" Jun 03 15:22:15.294984 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.294959 2527 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-xm6t2" Jun 03 15:22:15.417154 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.417100 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86b6644fd4-lwpcf_d7e14a46-ceb0-4a46-85ac-8411acb98aaf/nginx/0.log" Jun 03 15:22:15.468384 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.468357 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gvqj4_746a091a-6b49-4d6a-bb13-739ac387da73/manager/0.log" Jun 03 15:22:15.508659 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.508627 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-vl84w_cead805a-d731-4aba-9851-ea1f23b14a8a/manager/0.log" Jun 03 15:22:15.549554 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.549461 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674995-cmjpn_d653db19-5b63-485d-b3d3-30fe122de94f/cleanup/0.log" Jun 03 15:22:15.598085 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.598061 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-p8qb8_3d04ae84-31a8-49df-9486-a52b6a3fe8f3/server/0.log" Jun 03 15:22:15.664453 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.664418 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lvbks_9d28aad4-3db2-46b7-a48e-f9d085e0661a/manager/0.log" Jun 03 15:22:15.767206 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.767123 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-98tvs_dfeb9898-3fd8-40a3-aac0-d7b638264c69/manager/0.log" Jun 03 15:22:15.783086 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:15.783062 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-98tvs_dfeb9898-3fd8-40a3-aac0-d7b638264c69/copy-manifests/0.log" Jun 03 15:22:24.031611 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.031509 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-88d45_252e10c8-b1ee-4a03-85e6-fa495ec5bce3/kube-multus/0.log" Jun 03 15:22:24.082720 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.082694 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/kube-multus-additional-cni-plugins/0.log" Jun 03 15:22:24.110089 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.110065 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/egress-router-binary-copy/0.log" Jun 03 15:22:24.133250 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.133215 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/cni-plugins/0.log" Jun 03 15:22:24.153515 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.153477 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/bond-cni-plugin/0.log" Jun 03 15:22:24.172266 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.172233 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/routeoverride-cni/0.log" Jun 03 15:22:24.190607 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.190579 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/whereabouts-cni-bincopy/0.log" Jun 03 15:22:24.209090 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.209059 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dnpwj_80193d7d-1a8d-46c9-8848-93f381632d27/whereabouts-cni/0.log" Jun 03 15:22:24.650685 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.650638 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t845l_f2760330-a219-489c-921b-65a7676e0847/network-metrics-daemon/0.log" Jun 03 15:22:24.672964 ip-10-0-133-25 kubenswrapper[2527]: I0603 15:22:24.672936 2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t845l_f2760330-a219-489c-921b-65a7676e0847/kube-rbac-proxy/0.log"