Jun 02 01:40:40.494794 ip-10-0-129-109 systemd[1]: Starting Kubernetes Kubelet...
Jun 02 01:40:40.980852 ip-10-0-129-109 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:40:40.980852 ip-10-0-129-109 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 02 01:40:40.980852 ip-10-0-129-109 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:40:40.980852 ip-10-0-129-109 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 02 01:40:40.980852 ip-10-0-129-109 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:40:40.982913 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.982822    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 02 01:40:40.986729 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986711    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:40:40.986729 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986727    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:40:40.986729 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986732    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:40:40.986729 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986736    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986740    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986746    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986750    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986754    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986757    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986761    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986764    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986769    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986773    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986776    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986780    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986783    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986787    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986791    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986805    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986809    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986813    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986817    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986821    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:40:40.986963 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986825    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986828    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986832    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986836    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986840    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986844    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986848    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986852    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986857    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986861    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986866    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986870    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986875    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986879    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986883    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986888    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986892    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986896    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986900    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:40:40.987790 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986905    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986910    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986914    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986920    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986924    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986929    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986933    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986938    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986942    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986946    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986950    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986954    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986959    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986962    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986966    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986973    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986979    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986984    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986989    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986993    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:40:40.988474 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.986997    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987001    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987008    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987014    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987020    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987025    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987031    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987037    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987041    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987046    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987050    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987055    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987060    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987064    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987068    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987072    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987076    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987080    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987084    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:40:40.989000 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987088    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987092    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987096    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987100    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987105    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987792    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987803    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987808    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987813    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987817    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987821    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987826    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987830    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987834    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987838    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987842    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987846    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987850    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987854    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987858    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:40:40.989525 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987863    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987867    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987871    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987883    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987888    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987892    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987896    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987900    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987904    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987908    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987913    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987917    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987921    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987925    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987929    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987933    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987937    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987941    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987946    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987950    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:40:40.990100 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987954    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987959    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987963    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987967    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987972    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987976    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987980    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987984    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987988    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987993    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.987997    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988001    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988006    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988013    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988017    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988021    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988033    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988037    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988041    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:40:40.990990 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988045    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988049    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988053    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988057    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988061    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988066    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988070    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988074    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988078    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988082    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988086    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988090    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988098    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988102    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988107    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988111    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988115    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988119    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988123    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:40:40.991730 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988127    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988135    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988140    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988145    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988149    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988154    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988165    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988169    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988174    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988178    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988190    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.988195    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989873    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989890    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989906    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989913    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989920    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989925    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989932    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989939    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989944    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 02 01:40:40.992428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989949    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989955    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989960    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989965    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989970    2562 flags.go:64] FLAG: --cgroup-root=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989975    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989980    2562 flags.go:64] FLAG: --client-ca-file=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989985    2562 flags.go:64] FLAG: --cloud-config=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989990    2562 flags.go:64] FLAG: --cloud-provider="external"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.989994    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990004    2562 flags.go:64] FLAG: --cluster-domain=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990008    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990014    2562 flags.go:64] FLAG: --config-dir=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990018    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990024    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990030    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990035    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990041    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990046    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990051    2562 flags.go:64] FLAG: --contention-profiling="false"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990071    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990078    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990092    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990097    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990103    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 02 01:40:40.993098 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990108    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990113    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990117    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990122    2562 flags.go:64] FLAG: --enable-server="true"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990127    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990139    2562 flags.go:64] FLAG: --event-burst="100"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990144    2562 flags.go:64] FLAG: --event-qps="50"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990149    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990154    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990159    2562 flags.go:64] FLAG: --eviction-hard=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990165    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990170    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990175    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990179    2562 flags.go:64] FLAG: --eviction-soft=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990184    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990189    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990194    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990198    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990203    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990208    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990212    2562 flags.go:64] FLAG: --feature-gates=""
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990219    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990224    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990229    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990234    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990239    2562 flags.go:64] FLAG: --healthz-port="10248"
Jun 02 01:40:40.993791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990244    2562 flags.go:64] FLAG: --help="false"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990248    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-129-109.ec2.internal"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990253    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990258    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990271    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990277    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990283    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990298    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990304    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990310    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990316    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990321    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990326    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990331    2562 flags.go:64] FLAG: --kube-reserved=""
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990336    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990340    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990345    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990350    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990354    2562 flags.go:64] FLAG: --lock-file=""
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990359    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990364    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990369    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990377    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 02 01:40:40.994433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990382    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990387    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990391    2562 flags.go:64] FLAG: --logging-format="text"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990396    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990402    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990406    2562 flags.go:64] FLAG: --manifest-url=""
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990411    2562 flags.go:64] FLAG: --manifest-url-header=""
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990418    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990423    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990429    2562 flags.go:64] FLAG: --max-pods="110"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990434    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990440    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990444    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990449    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990462    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990467    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990472    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990485    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990490    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990494    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990515    2562 flags.go:64] FLAG: --pod-cidr=""
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990520    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990529    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990534    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 02 01:40:40.995013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990538    2562 flags.go:64] FLAG: --pods-per-core="0"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990543    2562 flags.go:64] FLAG: --port="10250"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990548    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990553    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05187c17fbed0101f"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990559    2562 flags.go:64] FLAG: --qos-reserved=""
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990564    2562 flags.go:64] FLAG: --read-only-port="10255"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990568    2562 flags.go:64] FLAG: --register-node="true"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990573    2562 flags.go:64] FLAG: --register-schedulable="true"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990578    2562 flags.go:64] FLAG: --register-with-taints=""
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990584    2562 flags.go:64] FLAG: --registry-burst="10"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990589    2562 flags.go:64] FLAG: --registry-qps="5"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990594    2562 flags.go:64] FLAG: --reserved-cpus=""
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990598    2562 flags.go:64] FLAG: --reserved-memory=""
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990605    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990610    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990615    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990619    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990624    2562 flags.go:64] FLAG: --runonce="false"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990632    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990638    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990643    2562 flags.go:64] FLAG: --seccomp-default="false"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990647    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990652    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990672    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990679    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990683    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jun 02 01:40:40.995626 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990688    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990693    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990697    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990702    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990707    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990712    2562 flags.go:64] FLAG: --system-cgroups=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990717    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990726    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990731    2562 flags.go:64] FLAG: --tls-cert-file=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990735    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990748    2562 flags.go:64] FLAG: --tls-min-version=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990753    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990758    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990762    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990767    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990772    2562 flags.go:64] FLAG: --v="2"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990784    2562 flags.go:64] FLAG: --version="false"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990790    2562 flags.go:64] FLAG: --vmodule=""
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990797    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.990802    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.990990    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.990997    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991002    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:40:40.996241 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991008    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991029    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991035    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991040    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991044    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991049    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991053    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991065    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991070    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991074    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991078    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991082    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991087    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991091    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991095    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991099    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991104    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991107    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991114    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991119    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:40:40.996851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991123    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991128    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991132    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991136    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991140    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991145    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991149    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991153    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991157    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991161    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991166    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991170    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991174    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991180    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991184    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991188    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991193    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991197    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991202    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991206    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:40:40.997341 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991217    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991222    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991226    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991230    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991234    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991239    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991243    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991247    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991252    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991256    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991260    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991264    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991268    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991272    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991276    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991280    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991288    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991292    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991296    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:40:40.997843 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991301    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991305    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991309    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991314    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991318    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991322    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991328    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991332    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991336    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991340    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991344    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991348    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991352    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991356    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991369    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991373    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991378    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991382    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991386    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991391    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:40:40.998316 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991396    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991400    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991404    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.991408    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.991416    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.997961    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.997976    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998021    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998026    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998029    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998032    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998035    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998038    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998041    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998044    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998047    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:40:40.998851 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998049    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998053    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998055    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998058    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998061    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998063    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998066    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998069    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998071    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998074    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998076    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998079    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998081    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998085    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998088    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998091    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998094    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998097    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:40:40.999238 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998101    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998105    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998108    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998111    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998119    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998123    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998126    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998128    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998131    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998134    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998137    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998139    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998142    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998145    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998147    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998150    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998152    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998155    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998157    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998160    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:40:40.999706 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998162    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998165    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998167    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998170    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998172    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998175    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998177    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998180    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998182    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998185    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998187    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998190    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998192    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998195    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998197    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998199    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998204    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998207    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998210    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998212    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:40:41.000204 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998215    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998217    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998220    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998222    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998225    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998227    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998230    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998232    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998235    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998238    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998240    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998243    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998245    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998248    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998250    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998253    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998255    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998258    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:40:41.000738 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998260    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.998265    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998374    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998379    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998382    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998384    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998387    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998390    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998393    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998395    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998398    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998403    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998413    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998416    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998419    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:40:41.001183 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998422    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998424    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998427    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998430    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998433    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998436    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998438    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998441    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998444    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998447    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998449    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998452    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998455    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998457    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998459    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998462    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998465    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998467    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998470    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998472    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:40:41.001570 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998475    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998478    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998480    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998483    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998485    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998488    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998490    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998493    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998496    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998512    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998524    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998528    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998531    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998534    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998537    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998539    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998542    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998544    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998547    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998549    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:40:41.002048 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998552    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998554    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998557    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998559    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998562    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998564    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998567    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998569    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998572    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998574    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998577    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998580    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998582    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998585    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998587    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998590    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998592    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998594    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998597    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998599    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:40:41.002583 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998602    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998604    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998607    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998615    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998618    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998620    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998622    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998625    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998627    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998630    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998632    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998635    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:40.998637    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.998642    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:40.999352    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 02 01:40:41.003059 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.001411    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 02 01:40:41.003418 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.002535    2562 server.go:1019] "Starting client certificate rotation"
Jun 02 01:40:41.003418 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.002634    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 01:40:41.003661 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.003643    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 01:40:41.031724 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.031708    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 01:40:41.033713 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.033687    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 01:40:41.045994 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.045975    2562 log.go:25] "Validated CRI v1 runtime API"
Jun 02 01:40:41.052523 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.052495    2562 log.go:25] "Validated CRI v1 image API"
Jun 02 01:40:41.054054 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.054031    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 02 01:40:41.056482 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.056464    2562 fs.go:135] Filesystem UUIDs: map[38333ebf-1526-4f01-8b24-4ab26512a460:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dc9b8bee-5624-4c93-8db2-652e8018ca73:/dev/nvme0n1p4]
Jun 02 01:40:41.056544 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.056483    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 02 01:40:41.061363 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.061249    2562 manager.go:217] Machine: {Timestamp:2026-06-02 01:40:41.060705476 +0000 UTC m=+0.437956996 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100478 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e4c514b1589f7ed576e6676c266e SystemUUID:ec24e4c5-14b1-589f-7ed5-76e6676c266e BootID:37f9d108-50a8-486d-9eed-c438af282b16 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:75:4a:53:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:75:4a:53:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:bd:5e:20:9b:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 02 01:40:41.062420 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.062409    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 02 01:40:41.062512 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.062489    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 02 01:40:41.063708 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063688    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 02 01:40:41.063834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063710    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 02 01:40:41.063883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063843    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jun 02 01:40:41.063883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063852    2562 container_manager_linux.go:306] "Creating device plugin manager"
Jun 02 01:40:41.063883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063859    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 01:40:41.063883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.063874    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 01:40:41.065684 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.065673    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 01:40:41.065933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.065924    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 02 01:40:41.069832 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.069822    2562 kubelet.go:491] "Attempting to sync node with API server"
Jun 02 01:40:41.070007 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.069998    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 02 01:40:41.070043 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.069995    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 01:40:41.070043 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.070013    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 02 01:40:41.070043 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.070023    2562 kubelet.go:397] "Adding apiserver pod source"
Jun 02 01:40:41.070043 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.070032    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 02 01:40:41.071387 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.071376    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 01:40:41.071444 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.071394    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 01:40:41.075106 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.075088    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 02 01:40:41.077115 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.077096    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 02 01:40:41.080066 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080052    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 02 01:40:41.080066 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080069    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080075    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080081    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080089    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080095    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080100    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080106    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080113    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080119    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080127    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 02 01:40:41.080196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.080133    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 02 01:40:41.081159 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.081149    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 02 01:40:41.081159 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.081159    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 02 01:40:41.081551 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.081528    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 02 01:40:41.081590 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.081533    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 02 01:40:41.084079 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.084065    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 02 01:40:41.084143 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.084100    2562 server.go:1295] "Started kubelet"
Jun 02 01:40:41.084197 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.084167    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 02 01:40:41.084315 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.084246    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 02 01:40:41.084349 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.084338    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 02 01:40:41.084925 ip-10-0-129-109 systemd[1]: Started Kubernetes Kubelet.
Jun 02 01:40:41.085681 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.085451    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 02 01:40:41.087482 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.087460    2562 server.go:317] "Adding debug handlers to kubelet server"
Jun 02 01:40:41.092455 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.092434    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 02 01:40:41.093447 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.092475    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-109.ec2.internal.18b52006c18da6b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-109.ec2.internal,UID:ip-10-0-129-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-109.ec2.internal,},FirstTimestamp:2026-06-02 01:40:41.084077748 +0000 UTC m=+0.461329268,LastTimestamp:2026-06-02 01:40:41.084077748 +0000 UTC m=+0.461329268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-109.ec2.internal,}"
Jun 02 01:40:41.093786 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.093759    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 02 01:40:41.094340 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.094324    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 02 01:40:41.094825 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.094807    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 02 01:40:41.095029 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095009    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 02 01:40:41.095029 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095024    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 02 01:40:41.095173 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095122    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 02 01:40:41.095225 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095182    2562 reconstruct.go:97] "Volume reconstruction finished"
Jun 02 01:40:41.095225 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095189    2562 reconciler.go:26] "Reconciler: start to sync state"
Jun 02 01:40:41.095693 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095674    2562 factory.go:153] Registering CRI-O factory
Jun 02 01:40:41.095766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095702    2562 factory.go:223] Registration of the crio container factory successfully
Jun 02 01:40:41.095766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095745    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 02 01:40:41.095766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095753    2562 factory.go:55] Registering systemd factory
Jun 02 01:40:41.095766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095761    2562 factory.go:223] Registration of the systemd container factory successfully
Jun 02 01:40:41.096053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095776    2562 factory.go:103] Registering Raw factory
Jun 02 01:40:41.096053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.095792    2562 manager.go:1196] Started watching for new ooms in manager
Jun 02 01:40:41.096254 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.096218    2562 manager.go:319] Starting recovery of all containers
Jun 02 01:40:41.096361 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.096346    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.101128 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.101102    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 02 01:40:41.101253 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.101231    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 02 01:40:41.106930 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.106785    2562 manager.go:324] Recovery completed
Jun 02 01:40:41.111691 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.111679    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.113548 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.113529    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.113631 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.113562    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.113631 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.113578    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.114029 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.114017    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 02 01:40:41.114074 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.114030    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 02 01:40:41.114074 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.114048    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 01:40:41.115147 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.115087    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-109.ec2.internal.18b52006c34f50bc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-109.ec2.internal,UID:ip-10-0-129-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-109.ec2.internal,},FirstTimestamp:2026-06-02 01:40:41.11354694 +0000 UTC m=+0.490798464,LastTimestamp:2026-06-02 01:40:41.11354694 +0000 UTC m=+0.490798464,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-109.ec2.internal,}"
Jun 02 01:40:41.117004 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.116992    2562 policy_none.go:49] "None policy: Start"
Jun 02 01:40:41.117041 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.117009    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 02 01:40:41.117041 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.117020    2562 state_mem.go:35] "Initializing new in-memory state store"
Jun 02 01:40:41.119606 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.119589    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2dgm"
Jun 02 01:40:41.129229 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.129160    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-109.ec2.internal.18b52006c34fa6fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-109.ec2.internal,UID:ip-10-0-129-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-109.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-109.ec2.internal,},FirstTimestamp:2026-06-02 01:40:41.11356902 +0000 UTC m=+0.490820541,LastTimestamp:2026-06-02 01:40:41.11356902 +0000 UTC m=+0.490820541,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-109.ec2.internal,}"
Jun 02 01:40:41.129309 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.129264    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2dgm"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.151195    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.152354    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.152373    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.152389    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.152395    2562 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.152430    2562 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jun 02 01:40:41.156053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.155383    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:41.161084 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161072    2562 manager.go:341] "Starting Device Plugin manager"
Jun 02 01:40:41.161127 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.161099    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 02 01:40:41.161127 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161109    2562 server.go:85] "Starting device plugin registration server"
Jun 02 01:40:41.161350 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161326    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 02 01:40:41.161400 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161352    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 02 01:40:41.161442 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161431    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 02 01:40:41.161698 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161596    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 02 01:40:41.161698 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.161612    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 02 01:40:41.161897 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.161878    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 02 01:40:41.161965 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.161917    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.253485 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.253419    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"]
Jun 02 01:40:41.253601 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.253494    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.255236 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.255218    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.255312 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.255249    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.255312 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.255259    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.256590 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.256578    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.256694 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.256679    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.256745 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.256711    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.257270 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257253    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.257270 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257273    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.257377 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257282    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.257377 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257295    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.257377 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257317    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.257377 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.257327    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.258392 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.258376    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.258449 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.258408    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.259040 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.259024    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.259120 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.259053    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.259120 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.259067    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.261519 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.261491    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:40:41.262188 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.262176    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:40:41.262241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.262196    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:40:41.262241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.262205    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:40:41.262241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.262224    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.269095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.269080    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.269166 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.269099    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-109.ec2.internal\": node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.274040 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.274025    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-109.ec2.internal\" not found" node="ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.277714 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.277700    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-109.ec2.internal\" not found" node="ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.296318 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.296300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.296394 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.296325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.296394 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.296343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1cf0e2e5f90b2e7a259d62b92d25592d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-109.ec2.internal\" (UID: \"1cf0e2e5f90b2e7a259d62b92d25592d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.303306 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.303287    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.397140 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397120    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.397218 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397143    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.397218 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397159    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1cf0e2e5f90b2e7a259d62b92d25592d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-109.ec2.internal\" (UID: \"1cf0e2e5f90b2e7a259d62b92d25592d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.397218 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1cf0e2e5f90b2e7a259d62b92d25592d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-109.ec2.internal\" (UID: \"1cf0e2e5f90b2e7a259d62b92d25592d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.397320 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397217    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.397320 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.397223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e40653d4a738f259f69339aae3f29fa6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal\" (UID: \"e40653d4a738f259f69339aae3f29fa6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.404236 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.404219    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.504323 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.504268    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.576697 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.576678    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.581532 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.581488    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:41.604607 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.604589    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.705086 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.705065    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.805582 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:41.805527    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-109.ec2.internal\" not found"
Jun 02 01:40:41.897976 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.897957    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:41.995577 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:41.995554    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:42.001780 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.001767    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 02 01:40:42.001896 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.001878    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 02 01:40:42.001955 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.001875    2562 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://a3aa42e41384546e281191cb33b463a4-3dd1856a46811cf0.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.129.109:55280->98.80.28.39:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:42.001955 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.001917    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal"
Jun 02 01:40:42.002045 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.001877    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 02 01:40:42.037420 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.037401    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 02 01:40:42.070734 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.070691    2562 apiserver.go:52] "Watching apiserver"
Jun 02 01:40:42.078972 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.078956    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 02 01:40:42.079364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.079343    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-94mpp","kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87","openshift-dns/node-resolver-jrrrf","openshift-image-registry/node-ca-xlzh6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal","openshift-multus/multus-gnff6","openshift-network-operator/iptables-alerter-lfm4m","openshift-ovn-kubernetes/ovnkube-node-4cg9l","kube-system/konnectivity-agent-hgx2j","openshift-cluster-node-tuning-operator/tuned-vzn9v","openshift-multus/multus-additional-cni-plugins-zzbhj","openshift-multus/network-metrics-daemon-tb55s"]
Jun 02 01:40:42.080790 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.080773    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.082583 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.082562    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.083776 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.083757    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.084777 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.084757    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.086024 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.086003    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:42.086110 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.086061    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:42.088769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.087398    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.088769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.088525    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 02 01:40:42.088769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.088645    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.088949 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.088854    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.088949 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.088863    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.088949 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.088926    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.089380 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.089362    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 02 01:40:42.089530 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.089378    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 02 01:40:42.089530 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.089424    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.089530 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.089463    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qlxkf\""
Jun 02 01:40:42.090057 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090027    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 02 01:40:42.090142 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090070    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4mwz\""
Jun 02 01:40:42.090198 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090175    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.090198 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090179    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.090298 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090271    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.090347 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090325    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 02 01:40:42.090347 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090330    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-29sxf\""
Jun 02 01:40:42.090430 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090394    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.090473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090441    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vcwnn\""
Jun 02 01:40:42.090653 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090639    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.090719 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.090665    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.091377 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.091357    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxtc8\""
Jun 02 01:40:42.091453 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.091357    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.091666 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.091651    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:42.092172 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.092148    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.093720 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.093695    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.094838 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.094825    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 02 01:40:42.094889 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.094869    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.094939 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.094924    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:42.096535 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.096517    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 02 01:40:42.098391 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098221    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 02 01:40:42.098583 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098562    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 02 01:40:42.098679 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098654    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.099139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098837    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.099139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098862    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 02 01:40:42.099139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.098995    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wd4bz\""
Jun 02 01:40:42.099139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099038    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 02 01:40:42.099139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099116    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 02 01:40:42.099396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099271    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 02 01:40:42.099485 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099470    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 02 01:40:42.099555 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099534    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9pqwn\""
Jun 02 01:40:42.099555 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099548    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 02 01:40:42.099651 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099575    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 02 01:40:42.099651 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099577    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tr5xm\""
Jun 02 01:40:42.099651 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099599    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gwhgw\""
Jun 02 01:40:42.099758 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099667    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 02 01:40:42.099833 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn95f\" (UniqueName: \"kubernetes.io/projected/9afe13f7-a2e7-4391-ad82-4521bde541ed-kube-api-access-sn95f\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.099868 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.099868 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f765a2e-2911-4391-8e7f-5ef7d59726eb-host\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.099933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.099933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-sys\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.099997 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-var-lib-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100033 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.099993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-netns\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.100033 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-hosts-file\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.100096 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.100096 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpb5p\" (UniqueName: \"kubernetes.io/projected/0f765a2e-2911-4391-8e7f-5ef7d59726eb-kube-api-access-bpb5p\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.100177 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-lib-modules\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100177 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovn-node-metrics-cert\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100177 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-host\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-node-log\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-config\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-multus\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.100289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-konnectivity-ca\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.100289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-modprobe-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-run\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-systemd-units\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.100473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-bin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-multus-certs\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s97f\" (UniqueName: \"kubernetes.io/projected/56031365-31ca-4f8b-99ed-bcad969c5762-kube-api-access-4s97f\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysconfig\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-kubernetes\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-etc-tuned\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-log-socket\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-script-lib\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6lr\" (UniqueName: \"kubernetes.io/projected/ce9280b0-a52f-4763-b88b-665187c9cffe-kube-api-access-5z6lr\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-conf\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxg5z\" (UniqueName: \"kubernetes.io/projected/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-kube-api-access-gxg5z\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-sys-fs\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-os-release\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.100952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-daemon-config\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-registration-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.100981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56031365-31ca-4f8b-99ed-bcad969c5762-host-slash\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-agent-certs\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-cnibin\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-bin\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-os-release\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-socket-dir-parent\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-hostroot\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56031365-31ca-4f8b-99ed-bcad969c5762-iptables-alerter-script\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-tmp\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.101331 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4p2z\" (UniqueName: \"kubernetes.io/projected/8657642f-9d79-4d85-94df-b1032bf9123c-kube-api-access-h4p2z\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-ovn\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-cnibin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-kubelet\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-tmp-dir\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-slash\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-netd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-env-overrides\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-device-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f765a2e-2911-4391-8e7f-5ef7d59726eb-serviceca\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-systemd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-systemd\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-var-lib-kubelet\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gqt\" (UniqueName: \"kubernetes.io/projected/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-kube-api-access-c6gqt\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:42.101852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-etc-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-system-cni-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.101976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-system-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-cni-binary-copy\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-k8s-cni-cncf-io\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-conf-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-etc-kubernetes\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-socket-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-kubelet\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-netns\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vztgf\" (UniqueName: \"kubernetes.io/projected/0b228450-b6c0-44b8-945d-b44fc950d2e9-kube-api-access-vztgf\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.102525 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.102292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzpw\" (UniqueName: \"kubernetes.io/projected/be8a97ef-f733-469d-b072-d43918a0f0df-kube-api-access-zxzpw\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.112690 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.112671    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 01:40:42.131120 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.131093    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:35:41 +0000 UTC" deadline="2027-12-19 04:31:02.782547658 +0000 UTC"
Jun 02 01:40:42.131120 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.131116    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13562h50m20.651433379s"
Jun 02 01:40:42.133380 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.133362    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjljt"
Jun 02 01:40:42.141541 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.141520    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjljt"
Jun 02 01:40:42.148433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.148414    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:42.182898 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.182869    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf0e2e5f90b2e7a259d62b92d25592d.slice/crio-cc34d4608d34ae321b63972b394e5e4ed244b761e88829311d73581d5858262a WatchSource:0}: Error finding container cc34d4608d34ae321b63972b394e5e4ed244b761e88829311d73581d5858262a: Status 404 returned error can't find the container with id cc34d4608d34ae321b63972b394e5e4ed244b761e88829311d73581d5858262a
Jun 02 01:40:42.184336 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.184307    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40653d4a738f259f69339aae3f29fa6.slice/crio-dbf9e8b6fd1b04aab6b5f487c5fe4d649305451335ede7b897edb1c1658aae93 WatchSource:0}: Error finding container dbf9e8b6fd1b04aab6b5f487c5fe4d649305451335ede7b897edb1c1658aae93: Status 404 returned error can't find the container with id dbf9e8b6fd1b04aab6b5f487c5fe4d649305451335ede7b897edb1c1658aae93
Jun 02 01:40:42.190076 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.190050    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 01:40:42.202517 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202485    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.202584 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202533    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vztgf\" (UniqueName: \"kubernetes.io/projected/0b228450-b6c0-44b8-945d-b44fc950d2e9-kube-api-access-vztgf\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.202584 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202559    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzpw\" (UniqueName: \"kubernetes.io/projected/be8a97ef-f733-469d-b072-d43918a0f0df-kube-api-access-zxzpw\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.202664 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202587    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sn95f\" (UniqueName: \"kubernetes.io/projected/9afe13f7-a2e7-4391-ad82-4521bde541ed-kube-api-access-sn95f\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.202664 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202612    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.202664 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202635    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f765a2e-2911-4391-8e7f-5ef7d59726eb-host\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.202820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f765a2e-2911-4391-8e7f-5ef7d59726eb-host\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.202820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.202820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.202820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202800    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-sys\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.202820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202818    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-var-lib-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202836    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-netns\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202861    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-hosts-file\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-netns\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-var-lib-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-sys\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202925    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-hosts-file\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202969    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.202993    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpb5p\" (UniqueName: \"kubernetes.io/projected/0f765a2e-2911-4391-8e7f-5ef7d59726eb-kube-api-access-bpb5p\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203021    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-lib-modules\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203047    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovn-node-metrics-cert\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203077    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-host\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203101    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-node-log\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203123    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-config\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-lib-modules\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203147    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-multus\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-konnectivity-ca\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-node-log\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203195    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-modprobe-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-host\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203220    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-run\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203232    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-multus\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203257    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-systemd-units\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203279    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-modprobe-d\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203284    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-run\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-systemd-units\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203314    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203347    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 02 01:40:42.203769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203366    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-bin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203391    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-multus-certs\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203419    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s97f\" (UniqueName: \"kubernetes.io/projected/56031365-31ca-4f8b-99ed-bcad969c5762-kube-api-access-4s97f\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203442    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysconfig\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203466    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-kubernetes\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-multus-certs\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203491    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-etc-tuned\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203538    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-log-socket\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203566    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-script-lib\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203591    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6lr\" (UniqueName: \"kubernetes.io/projected/ce9280b0-a52f-4763-b88b-665187c9cffe-kube-api-access-5z6lr\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203617    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-conf\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203643    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxg5z\" (UniqueName: \"kubernetes.io/projected/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-kube-api-access-gxg5z\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203669    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-sys-fs\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203712    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-os-release\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203738    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203739    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-konnectivity-ca\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.204396 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203763    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-daemon-config\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203786    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-registration-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203827    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-registration-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203833    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56031365-31ca-4f8b-99ed-bcad969c5762-host-slash\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203855    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-agent-certs\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203877    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-cnibin\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203898    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-bin\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-sys-fs\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203919    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-os-release\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203978    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-socket-dir-parent\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204001    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-hostroot\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204022    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56031365-31ca-4f8b-99ed-bcad969c5762-iptables-alerter-script\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204043    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-tmp\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204068    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4p2z\" (UniqueName: \"kubernetes.io/projected/8657642f-9d79-4d85-94df-b1032bf9123c-kube-api-access-h4p2z\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204092    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-ovn\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204116    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-cnibin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.205185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204166    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-kubelet\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204191    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-tmp-dir\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204215    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-slash\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204258    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-netd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204283    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-env-overrides\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b228450-b6c0-44b8-945d-b44fc950d2e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-device-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204355    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f765a2e-2911-4391-8e7f-5ef7d59726eb-serviceca\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204366    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-config\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204372    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-cni-bin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovnkube-script-lib\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.203910    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysctl-conf\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204423    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-systemd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204458    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204487    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-systemd\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-bin\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204527    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-var-lib-kubelet\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.206038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56031365-31ca-4f8b-99ed-bcad969c5762-host-slash\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204557    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gqt\" (UniqueName: \"kubernetes.io/projected/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-kube-api-access-c6gqt\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204585    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204613    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-etc-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204637    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204664    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-sysconfig\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204691    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-system-cni-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204733    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204738    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-system-cni-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204764    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f765a2e-2911-4391-8e7f-5ef7d59726eb-serviceca\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204794    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-system-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204819    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204822    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-cni-binary-copy\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-ovn\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-k8s-cni-cncf-io\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.206839 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204886    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-conf-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204900    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-cnibin\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204912    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-etc-kubernetes\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204943    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-var-lib-kubelet\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204949    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-socket-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204975    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-kubelet\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205002    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-netns\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-netns\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-os-release\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-systemd\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-var-lib-kubelet\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205203    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-tmp-dir\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-slash\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-cni-binary-copy\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-cni-netd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-etc-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-openvswitch\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205640    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-host-run-k8s-cni-cncf-io\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-env-overrides\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-conf-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-system-cni-dir\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-etc-kubernetes\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.204780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-run-systemd\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.205775    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-device-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.205853    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:40:42.705821291 +0000 UTC m=+2.083072821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-log-socket\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205953    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce9280b0-a52f-4763-b88b-665187c9cffe-socket-dir\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-host-kubelet\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8657642f-9d79-4d85-94df-b1032bf9123c-etc-kubernetes\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.205687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206162    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b228450-b6c0-44b8-945d-b44fc950d2e9-cnibin\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-socket-dir-parent\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-hostroot\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9afe13f7-a2e7-4391-ad82-4521bde541ed-os-release\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.207885 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206679    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-etc-tuned\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.208365 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206808    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8657642f-9d79-4d85-94df-b1032bf9123c-tmp\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.208365 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9afe13f7-a2e7-4391-ad82-4521bde541ed-multus-daemon-config\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.208365 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206932    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-ovn-node-metrics-cert\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.208365 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.206935    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56031365-31ca-4f8b-99ed-bcad969c5762-iptables-alerter-script\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.208365 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.207018    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99eb08d7-52a3-4184-a97f-ba0d08f5ae3c-agent-certs\") pod \"konnectivity-agent-hgx2j\" (UID: \"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c\") " pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.214109 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.214090    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:42.214207 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.214113    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:42.214207 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.214125    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:42.214207 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.214179    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:40:42.714161456 +0000 UTC m=+2.091412966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:42.214417 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.214289    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxg5z\" (UniqueName: \"kubernetes.io/projected/db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a-kube-api-access-gxg5z\") pod \"ovnkube-node-4cg9l\" (UID: \"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.214417 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.214395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vztgf\" (UniqueName: \"kubernetes.io/projected/0b228450-b6c0-44b8-945d-b44fc950d2e9-kube-api-access-vztgf\") pod \"multus-additional-cni-plugins-zzbhj\" (UID: \"0b228450-b6c0-44b8-945d-b44fc950d2e9\") " pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.214608 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.214590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s97f\" (UniqueName: \"kubernetes.io/projected/56031365-31ca-4f8b-99ed-bcad969c5762-kube-api-access-4s97f\") pod \"iptables-alerter-lfm4m\" (UID: \"56031365-31ca-4f8b-99ed-bcad969c5762\") " pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.214933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.214911    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4p2z\" (UniqueName: \"kubernetes.io/projected/8657642f-9d79-4d85-94df-b1032bf9123c-kube-api-access-h4p2z\") pod \"tuned-vzn9v\" (UID: \"8657642f-9d79-4d85-94df-b1032bf9123c\") " pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.215948 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.215928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpb5p\" (UniqueName: \"kubernetes.io/projected/0f765a2e-2911-4391-8e7f-5ef7d59726eb-kube-api-access-bpb5p\") pod \"node-ca-xlzh6\" (UID: \"0f765a2e-2911-4391-8e7f-5ef7d59726eb\") " pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.216806 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.216784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzpw\" (UniqueName: \"kubernetes.io/projected/be8a97ef-f733-469d-b072-d43918a0f0df-kube-api-access-zxzpw\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.216990 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.216973    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn95f\" (UniqueName: \"kubernetes.io/projected/9afe13f7-a2e7-4391-ad82-4521bde541ed-kube-api-access-sn95f\") pod \"multus-gnff6\" (UID: \"9afe13f7-a2e7-4391-ad82-4521bde541ed\") " pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.217037 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.216976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gqt\" (UniqueName: \"kubernetes.io/projected/3c31d2b1-dc03-4e5e-ac40-26dcc7605448-kube-api-access-c6gqt\") pod \"node-resolver-jrrrf\" (UID: \"3c31d2b1-dc03-4e5e-ac40-26dcc7605448\") " pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.217086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.217073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6lr\" (UniqueName: \"kubernetes.io/projected/ce9280b0-a52f-4763-b88b-665187c9cffe-kube-api-access-5z6lr\") pod \"aws-ebs-csi-driver-node-xtg87\" (UID: \"ce9280b0-a52f-4763-b88b-665187c9cffe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.413756 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.413678    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gnff6"
Jun 02 01:40:42.420561 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.420537    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afe13f7_a2e7_4391_ad82_4521bde541ed.slice/crio-44765b159f4a379226acc09809423cb7ac712c390276d1304403cc430dfe1eec WatchSource:0}: Error finding container 44765b159f4a379226acc09809423cb7ac712c390276d1304403cc430dfe1eec: Status 404 returned error can't find the container with id 44765b159f4a379226acc09809423cb7ac712c390276d1304403cc430dfe1eec
Jun 02 01:40:42.432601 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.432582    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87"
Jun 02 01:40:42.438822 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.438800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9280b0_a52f_4763_b88b_665187c9cffe.slice/crio-ec79ba4b6fec6ce5c50f3c301d5de5a46a4d302500b9e2d409c7b9db8597d4d7 WatchSource:0}: Error finding container ec79ba4b6fec6ce5c50f3c301d5de5a46a4d302500b9e2d409c7b9db8597d4d7: Status 404 returned error can't find the container with id ec79ba4b6fec6ce5c50f3c301d5de5a46a4d302500b9e2d409c7b9db8597d4d7
Jun 02 01:40:42.445513 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.445486    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrrrf"
Jun 02 01:40:42.450535 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.450515    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c31d2b1_dc03_4e5e_ac40_26dcc7605448.slice/crio-7040120df68c8140d6449f7a3afa312cd669fef3aac5a31a726b7add0c37cb67 WatchSource:0}: Error finding container 7040120df68c8140d6449f7a3afa312cd669fef3aac5a31a726b7add0c37cb67: Status 404 returned error can't find the container with id 7040120df68c8140d6449f7a3afa312cd669fef3aac5a31a726b7add0c37cb67
Jun 02 01:40:42.458362 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.458345    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xlzh6"
Jun 02 01:40:42.463672 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.463654    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f765a2e_2911_4391_8e7f_5ef7d59726eb.slice/crio-14dd4400ab8c793eafad277b3b4a0aef34ae66146dd22e08c8e943886e927e94 WatchSource:0}: Error finding container 14dd4400ab8c793eafad277b3b4a0aef34ae66146dd22e08c8e943886e927e94: Status 404 returned error can't find the container with id 14dd4400ab8c793eafad277b3b4a0aef34ae66146dd22e08c8e943886e927e94
Jun 02 01:40:42.478718 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.478700    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lfm4m"
Jun 02 01:40:42.483604 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.483587    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56031365_31ca_4f8b_99ed_bcad969c5762.slice/crio-3c53fc0536d02de911227888b29f2425433f2a83285e3fdf99ddde58798746a6 WatchSource:0}: Error finding container 3c53fc0536d02de911227888b29f2425433f2a83285e3fdf99ddde58798746a6: Status 404 returned error can't find the container with id 3c53fc0536d02de911227888b29f2425433f2a83285e3fdf99ddde58798746a6
Jun 02 01:40:42.486200 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.486186    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:40:42.491761 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.491741    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4cc45a_bc2c_4eaf_a328_a4f4f857ae9a.slice/crio-41366f8d44dd2dacc6e543686d03f643e000fbaeea5b6a350f9beba958c2ce5c WatchSource:0}: Error finding container 41366f8d44dd2dacc6e543686d03f643e000fbaeea5b6a350f9beba958c2ce5c: Status 404 returned error can't find the container with id 41366f8d44dd2dacc6e543686d03f643e000fbaeea5b6a350f9beba958c2ce5c
Jun 02 01:40:42.492356 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.492340    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:40:42.497827 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.497806    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vzn9v"
Jun 02 01:40:42.498003 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.497987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eb08d7_52a3_4184_a97f_ba0d08f5ae3c.slice/crio-eb4bcf2ad66297aeae87cee25d3a451b7222c76b88a060d65520cd4b54c3fc81 WatchSource:0}: Error finding container eb4bcf2ad66297aeae87cee25d3a451b7222c76b88a060d65520cd4b54c3fc81: Status 404 returned error can't find the container with id eb4bcf2ad66297aeae87cee25d3a451b7222c76b88a060d65520cd4b54c3fc81
Jun 02 01:40:42.503470 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.503452    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zzbhj"
Jun 02 01:40:42.504821 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.504801    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8657642f_9d79_4d85_94df_b1032bf9123c.slice/crio-6ecf43d9f4a8b6baa16c997997d150f710a1b0b2866bfe0c3ce7829aae27eb4d WatchSource:0}: Error finding container 6ecf43d9f4a8b6baa16c997997d150f710a1b0b2866bfe0c3ce7829aae27eb4d: Status 404 returned error can't find the container with id 6ecf43d9f4a8b6baa16c997997d150f710a1b0b2866bfe0c3ce7829aae27eb4d
Jun 02 01:40:42.508945 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:40:42.508925    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b228450_b6c0_44b8_945d_b44fc950d2e9.slice/crio-c3086a091e3ef11e10176d9bd42fd12ac8cf240c1c685b0ca6fe07b9b04381bb WatchSource:0}: Error finding container c3086a091e3ef11e10176d9bd42fd12ac8cf240c1c685b0ca6fe07b9b04381bb: Status 404 returned error can't find the container with id c3086a091e3ef11e10176d9bd42fd12ac8cf240c1c685b0ca6fe07b9b04381bb
Jun 02 01:40:42.709602 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.709511    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:42.709745 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.709643    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:42.709745 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.709701    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:40:43.709681481 +0000 UTC m=+3.086933005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:42.810130 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.810096    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:42.810283 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.810269    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:42.810360 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.810293    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:42.810360 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.810307    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:42.810455 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:42.810370    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:40:43.810350317 +0000 UTC m=+3.187601824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:42.956039 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:42.956009    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:43.143068 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.143031    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:35:42 +0000 UTC" deadline="2027-10-31 09:21:47.950882236 +0000 UTC"
Jun 02 01:40:43.143068 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.143067    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12391h41m4.807820031s"
Jun 02 01:40:43.155914 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.155883    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:43.156047 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.156018    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:43.169608 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.169539    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerStarted","Data":"c3086a091e3ef11e10176d9bd42fd12ac8cf240c1c685b0ca6fe07b9b04381bb"}
Jun 02 01:40:43.182571 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.182533    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vzn9v" event={"ID":"8657642f-9d79-4d85-94df-b1032bf9123c","Type":"ContainerStarted","Data":"6ecf43d9f4a8b6baa16c997997d150f710a1b0b2866bfe0c3ce7829aae27eb4d"}
Jun 02 01:40:43.190121 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.190094    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgx2j" event={"ID":"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c","Type":"ContainerStarted","Data":"eb4bcf2ad66297aeae87cee25d3a451b7222c76b88a060d65520cd4b54c3fc81"}
Jun 02 01:40:43.197861 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.197834    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"41366f8d44dd2dacc6e543686d03f643e000fbaeea5b6a350f9beba958c2ce5c"}
Jun 02 01:40:43.199674 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.199651    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lfm4m" event={"ID":"56031365-31ca-4f8b-99ed-bcad969c5762","Type":"ContainerStarted","Data":"3c53fc0536d02de911227888b29f2425433f2a83285e3fdf99ddde58798746a6"}
Jun 02 01:40:43.202417 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.202390    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xlzh6" event={"ID":"0f765a2e-2911-4391-8e7f-5ef7d59726eb","Type":"ContainerStarted","Data":"14dd4400ab8c793eafad277b3b4a0aef34ae66146dd22e08c8e943886e927e94"}
Jun 02 01:40:43.211612 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.211564    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrrrf" event={"ID":"3c31d2b1-dc03-4e5e-ac40-26dcc7605448","Type":"ContainerStarted","Data":"7040120df68c8140d6449f7a3afa312cd669fef3aac5a31a726b7add0c37cb67"}
Jun 02 01:40:43.215381 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.215332    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gnff6" event={"ID":"9afe13f7-a2e7-4391-ad82-4521bde541ed","Type":"ContainerStarted","Data":"44765b159f4a379226acc09809423cb7ac712c390276d1304403cc430dfe1eec"}
Jun 02 01:40:43.221914 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.221862    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87" event={"ID":"ce9280b0-a52f-4763-b88b-665187c9cffe","Type":"ContainerStarted","Data":"ec79ba4b6fec6ce5c50f3c301d5de5a46a4d302500b9e2d409c7b9db8597d4d7"}
Jun 02 01:40:43.227538 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.227515    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal" event={"ID":"e40653d4a738f259f69339aae3f29fa6","Type":"ContainerStarted","Data":"dbf9e8b6fd1b04aab6b5f487c5fe4d649305451335ede7b897edb1c1658aae93"}
Jun 02 01:40:43.230919 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.230896    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal" event={"ID":"1cf0e2e5f90b2e7a259d62b92d25592d","Type":"ContainerStarted","Data":"cc34d4608d34ae321b63972b394e5e4ed244b761e88829311d73581d5858262a"}
Jun 02 01:40:43.715295 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.715260    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:43.715480 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.715405    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:43.715480 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.715465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:40:45.715446766 +0000 UTC m=+5.092698276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:43.816337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:43.816303    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:43.816515 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.816483    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:43.816599 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.816521    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:43.816599 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.816535    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:43.816599 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:43.816590    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:40:45.816572691 +0000 UTC m=+5.193824216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:44.143714 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:44.143672    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:35:42 +0000 UTC" deadline="2027-11-17 08:47:18.770250264 +0000 UTC"
Jun 02 01:40:44.143714 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:44.143711    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12799h6m34.626542016s"
Jun 02 01:40:44.153180 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:44.153116    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:44.153339 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:44.153265    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:44.802540 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:44.802337    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:40:45.156234 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:45.155687    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:45.156234 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.155816    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:45.732858 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:45.732793    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:45.733036 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.732942    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:45.733036 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.733005    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:40:49.73298361 +0000 UTC m=+9.110235135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:45.834298 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:45.834057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:45.834447 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.834430    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:45.834522 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.834450    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:45.834522 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.834463    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:45.834626 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:45.834538    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:40:49.834519355 +0000 UTC m=+9.211770915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:46.152842 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:46.152764    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:46.152982 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:46.152895    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:47.154852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:47.154722    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:47.155325 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:47.154932    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:48.153209 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:48.153176    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:48.153472 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:48.153296    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:49.153763 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:49.153731    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:49.154181 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.153857    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:49.765374 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:49.765334    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:49.765570 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.765482    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:49.765570 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.765569    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:40:57.76554847 +0000 UTC m=+17.142799991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:49.866097 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:49.866062    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:49.866277 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.866208    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:49.866277 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.866226    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:49.866277 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.866239    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:49.866431 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:49.866292    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:40:57.86627536 +0000 UTC m=+17.243526871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:50.152670 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:50.152591    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:50.152884 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:50.152777    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:51.153565 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:51.153532    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:51.153967 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:51.153656    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:52.153343 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:52.153307    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:52.153529 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:52.153438    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:53.152948 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:53.152920    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:53.153413 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:53.153062    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:54.152988 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:54.152950    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:54.153401 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:54.153085    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:55.152958 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:55.152925    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:55.153105 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:55.153047    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:56.153101 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:56.153065    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:56.153545 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:56.153199    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:57.153614 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:57.153570    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:57.154098 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.153706    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:40:57.830974 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:57.830936    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:57.831183 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.831099    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:57.831183 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.831170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:41:13.831154764 +0000 UTC m=+33.208406276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:40:57.931516 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:57.931475    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:57.931677 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.931660    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:40:57.931744 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.931685    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:40:57.931744 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.931697    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:57.931832 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:57.931761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:41:13.93174624 +0000 UTC m=+33.308997753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:40:58.153161 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:58.153078    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:40:58.153312 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:58.153191    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:40:59.153652 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:40:59.153618    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:40:59.154060 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:40:59.153749    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:00.153332 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:00.153297    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:00.153510 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:00.153402    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:01.153585 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:01.153493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:01.153905 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:01.153652    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:02.153762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.153449    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:02.154390 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:02.153835    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:02.283274 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.283250    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="20d6cd1bbbeb3657f3c605f1ccda49b1717c20c22e004e705309a6b0eda5c25c" exitCode=0
Jun 02 01:41:02.283418 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.283316    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"20d6cd1bbbeb3657f3c605f1ccda49b1717c20c22e004e705309a6b0eda5c25c"}
Jun 02 01:41:02.284701 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.284631    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vzn9v" event={"ID":"8657642f-9d79-4d85-94df-b1032bf9123c","Type":"ContainerStarted","Data":"2f7d30911a1ca1d84e20d1726e630def78e994a081717f35712b2f5cb9f04cf8"}
Jun 02 01:41:02.285865 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.285837    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgx2j" event={"ID":"99eb08d7-52a3-4184-a97f-ba0d08f5ae3c","Type":"ContainerStarted","Data":"70f6c9651dfbf6db53e1b675c840d7a7df0c3a348bcc4e7f76d58ab53e2632b0"}
Jun 02 01:41:02.288083 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288065    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:41:02.288383 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288330    2562 generic.go:358] "Generic (PLEG): container finished" podID="db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a" containerID="4cc4123f98a58e3a9b13bdd20c8d0d566e0776b5175aa654fed29af70ad8b830" exitCode=1
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288393    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"d48395161ecd89c393814d226bc02e8bfe0d69081e637ff18c0072533538c555"}
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288415    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"9316b06a85ebb7df24d25ae2203af51ee23fe7fe5e98d258122248b399cb5497"}
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288425    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"96f7d2c6a761e5ddb21c93a11ece6926129f93ec751d1cb830a0122770381686"}
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288434    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"d79bf309b7a5310f7b4a228c83c2cab9e78fc1174a157ced150a9a96c2b1985c"}
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288442    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerDied","Data":"4cc4123f98a58e3a9b13bdd20c8d0d566e0776b5175aa654fed29af70ad8b830"}
Jun 02 01:41:02.288465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.288451    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"b31be782bde02340911e753c357c24c9df02450aca1e5838851d0e7c01385682"}
Jun 02 01:41:02.289785 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.289764    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xlzh6" event={"ID":"0f765a2e-2911-4391-8e7f-5ef7d59726eb","Type":"ContainerStarted","Data":"7ec65d1f958d0125a532e1bbc1689047a14c601d5ea55233956dc9d7ca57f5f2"}
Jun 02 01:41:02.290946 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.290925    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrrrf" event={"ID":"3c31d2b1-dc03-4e5e-ac40-26dcc7605448","Type":"ContainerStarted","Data":"78949b6e85f9ad89864e2b379d96226720c6d1628eddd51c891b8ee118b036c1"}
Jun 02 01:41:02.292104 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.292087    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gnff6" event={"ID":"9afe13f7-a2e7-4391-ad82-4521bde541ed","Type":"ContainerStarted","Data":"9a38925c605ccc6ef56dabcba22e03029b7c03d560bf04be8781707aa84d8526"}
Jun 02 01:41:02.293250 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.293227    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87" event={"ID":"ce9280b0-a52f-4763-b88b-665187c9cffe","Type":"ContainerStarted","Data":"b26e7a3b57850b6ab24ea7d1c58f7abb1f0003e27136d9b1a2fa38370c1d87b2"}
Jun 02 01:41:02.294320 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.294302    2562 generic.go:358] "Generic (PLEG): container finished" podID="e40653d4a738f259f69339aae3f29fa6" containerID="923145ceb7755124eb6bff2e66479d9bfad1df2c9d579af121d40c4c6c05ec70" exitCode=0
Jun 02 01:41:02.294397 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.294378    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal" event={"ID":"e40653d4a738f259f69339aae3f29fa6","Type":"ContainerDied","Data":"923145ceb7755124eb6bff2e66479d9bfad1df2c9d579af121d40c4c6c05ec70"}
Jun 02 01:41:02.295621 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.295601    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal" event={"ID":"1cf0e2e5f90b2e7a259d62b92d25592d","Type":"ContainerStarted","Data":"d1b2947e8f104248388ddffe261122363c7942b0bc681a16c97597716c02bc82"}
Jun 02 01:41:02.333139 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.333083    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-109.ec2.internal" podStartSLOduration=20.333067853 podStartE2EDuration="20.333067853s" podCreationTimestamp="2026-06-02 01:40:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:41:02.332484146 +0000 UTC m=+21.709735674" watchObservedRunningTime="2026-06-02 01:41:02.333067853 +0000 UTC m=+21.710319434"
Jun 02 01:41:02.333356 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.333323    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xlzh6" podStartSLOduration=2.612551832 podStartE2EDuration="21.333312092s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.465033492 +0000 UTC m=+1.842284999" lastFinishedPulling="2026-06-02 01:41:01.18579373 +0000 UTC m=+20.563045259" observedRunningTime="2026-06-02 01:41:02.319893065 +0000 UTC m=+21.697144594" watchObservedRunningTime="2026-06-02 01:41:02.333312092 +0000 UTC m=+21.710563657"
Jun 02 01:41:02.348679 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.348638    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gnff6" podStartSLOduration=2.520137156 podStartE2EDuration="21.34862328s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.421942716 +0000 UTC m=+1.799194227" lastFinishedPulling="2026-06-02 01:41:01.250428838 +0000 UTC m=+20.627680351" observedRunningTime="2026-06-02 01:41:02.348612108 +0000 UTC m=+21.725863639" watchObservedRunningTime="2026-06-02 01:41:02.34862328 +0000 UTC m=+21.725874811"
Jun 02 01:41:02.367211 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.367170    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hgx2j" podStartSLOduration=3.031146903 podStartE2EDuration="21.367154512s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.502129306 +0000 UTC m=+1.879380818" lastFinishedPulling="2026-06-02 01:41:00.83813692 +0000 UTC m=+20.215388427" observedRunningTime="2026-06-02 01:41:02.36682067 +0000 UTC m=+21.744072201" watchObservedRunningTime="2026-06-02 01:41:02.367154512 +0000 UTC m=+21.744406042"
Jun 02 01:41:02.384159 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:02.384115    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vzn9v" podStartSLOduration=2.70452503 podStartE2EDuration="21.384106191s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.506207944 +0000 UTC m=+1.883459452" lastFinishedPulling="2026-06-02 01:41:01.185789106 +0000 UTC m=+20.563040613" observedRunningTime="2026-06-02 01:41:02.383876147 +0000 UTC m=+21.761127675" watchObservedRunningTime="2026-06-02 01:41:02.384106191 +0000 UTC m=+21.761357720"
Jun 02 01:41:03.153326 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.153300    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:03.153467 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:03.153432    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:03.236271 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.236244    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 02 01:41:03.299130 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.299093    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lfm4m" event={"ID":"56031365-31ca-4f8b-99ed-bcad969c5762","Type":"ContainerStarted","Data":"893a6c2e5d8465fd1b8c0ba584b61f4d3ccde5c7725093f825955a63ed5e12e2"}
Jun 02 01:41:03.300804 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.300780    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87" event={"ID":"ce9280b0-a52f-4763-b88b-665187c9cffe","Type":"ContainerStarted","Data":"68207e43ca44f0d415f8c06dce4a3474033e4ae5d8216c5b833075561f719e44"}
Jun 02 01:41:03.302337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.302287    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal" event={"ID":"e40653d4a738f259f69339aae3f29fa6","Type":"ContainerStarted","Data":"134aa9d60cefc4cfa4d600caa81798c1b1f17d2635f98fc5fbf0d46eb3238013"}
Jun 02 01:41:03.315378 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.315327    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jrrrf" podStartSLOduration=3.550984362 podStartE2EDuration="22.31531212s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.451929046 +0000 UTC m=+1.829180566" lastFinishedPulling="2026-06-02 01:41:01.216256808 +0000 UTC m=+20.593508324" observedRunningTime="2026-06-02 01:41:02.419231622 +0000 UTC m=+21.796483152" watchObservedRunningTime="2026-06-02 01:41:03.31531212 +0000 UTC m=+22.692563650"
Jun 02 01:41:03.315703 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.315673    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lfm4m" podStartSLOduration=3.962313922 podStartE2EDuration="22.315662277s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.484869859 +0000 UTC m=+1.862121366" lastFinishedPulling="2026-06-02 01:41:00.838218204 +0000 UTC m=+20.215469721" observedRunningTime="2026-06-02 01:41:03.314964333 +0000 UTC m=+22.692215861" watchObservedRunningTime="2026-06-02 01:41:03.315662277 +0000 UTC m=+22.692913810"
Jun 02 01:41:03.328272 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:03.328237    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-109.ec2.internal" podStartSLOduration=21.328226323 podStartE2EDuration="21.328226323s" podCreationTimestamp="2026-06-02 01:40:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:41:03.328075797 +0000 UTC m=+22.705327327" watchObservedRunningTime="2026-06-02 01:41:03.328226323 +0000 UTC m=+22.705477852"
Jun 02 01:41:04.152812 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.152780    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:04.152997 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:04.152949    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:04.175426 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.175317    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:41:03.236267053Z","UUID":"bc1a675e-5aa7-4eb7-b8f8-544d390bc548","Handler":null,"Name":"","Endpoint":""}
Jun 02 01:41:04.177132 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.177114    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 02 01:41:04.177254 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.177139    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 02 01:41:04.697358 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.697339    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:41:04.697872 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.697856    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:41:04.705460 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.705445    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:41:04.705782 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:04.705766    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hgx2j"
Jun 02 01:41:05.152897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:05.152867    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:05.153048 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:05.153007    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:05.309198 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:05.309164    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87" event={"ID":"ce9280b0-a52f-4763-b88b-665187c9cffe","Type":"ContainerStarted","Data":"c69665e5b08b6e6ac9a90fb3468e466703b5a2c23a41b7ee3ee800e0b3ed3d58"}
Jun 02 01:41:05.315235 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:05.315211    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:41:05.315644 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:05.315617    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"668fb273ef78201ac47d9907b2305daab483899d559f1b0b65fe68dda681cf6b"}
Jun 02 01:41:05.334080 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:05.334039    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtg87" podStartSLOduration=2.088843797 podStartE2EDuration="24.334027521s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.440145498 +0000 UTC m=+1.817397004" lastFinishedPulling="2026-06-02 01:41:04.685329216 +0000 UTC m=+24.062580728" observedRunningTime="2026-06-02 01:41:05.326106097 +0000 UTC m=+24.703357625" watchObservedRunningTime="2026-06-02 01:41:05.334027521 +0000 UTC m=+24.711279047"
Jun 02 01:41:06.153270 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:06.153192    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:06.153659 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:06.153296    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:07.153105 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:07.152864    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:07.153269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:07.153222    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:08.153431 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.153391    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:08.154121 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:08.153489    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:08.322281 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.322251    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="59f7f3eea35a1a6c3f67729cd2b61b68ff68dc3b6ec85d79c309dd13e1941529" exitCode=0
Jun 02 01:41:08.322427 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.322326    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"59f7f3eea35a1a6c3f67729cd2b61b68ff68dc3b6ec85d79c309dd13e1941529"}
Jun 02 01:41:08.325369 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.325350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:41:08.325718 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.325697    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"e849eb87da4074344bcffbf53948cb03e0a491d0d2ec73620c84cb4db5278eba"}
Jun 02 01:41:08.325986 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.325966    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:08.326072 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.325993    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:08.326161 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.326142    2562 scope.go:117] "RemoveContainer" containerID="4cc4123f98a58e3a9b13bdd20c8d0d566e0776b5175aa654fed29af70ad8b830"
Jun 02 01:41:08.342840 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:08.342824    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:09.153402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.153252    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:09.153521 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:09.153484    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:09.330775 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.330689    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:41:09.331016 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.330991    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" event={"ID":"db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a","Type":"ContainerStarted","Data":"fcfc555320e8907a44350ba8397f9e7aa5faa31337ce5645e3d4d2f2b20efc27"}
Jun 02 01:41:09.331306 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.331265    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:09.333056 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.333013    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="b68d3419e087f7de256a4c42ab454a5faa39d586951c74aed3fd65a2e461092b" exitCode=0
Jun 02 01:41:09.333157 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.333064    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"b68d3419e087f7de256a4c42ab454a5faa39d586951c74aed3fd65a2e461092b"}
Jun 02 01:41:09.347110 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.347089    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:09.359857 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.359821    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l" podStartSLOduration=9.339672795 podStartE2EDuration="28.359808743s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.493172818 +0000 UTC m=+1.870424328" lastFinishedPulling="2026-06-02 01:41:01.513308766 +0000 UTC m=+20.890560276" observedRunningTime="2026-06-02 01:41:09.359450506 +0000 UTC m=+28.736702034" watchObservedRunningTime="2026-06-02 01:41:09.359808743 +0000 UTC m=+28.737060661"
Jun 02 01:41:09.515768 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.515742    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tb55s"]
Jun 02 01:41:09.515898 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.515828    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:09.515940 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:09.515912    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:09.518673 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.518648    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94mpp"]
Jun 02 01:41:09.518760 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:09.518733    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:09.518816 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:09.518802    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:10.336727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:10.336698    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="48f8afec8584757ba32c426179550d7a524fd8b7b013896a050acc4d31bfafe4" exitCode=0
Jun 02 01:41:10.337168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:10.336794    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"48f8afec8584757ba32c426179550d7a524fd8b7b013896a050acc4d31bfafe4"}
Jun 02 01:41:11.154967 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.154935    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:11.155153 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.155041    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:11.155153 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:11.155044    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:11.155153 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:11.155123    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:11.595435 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.595408    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9n6jp"]
Jun 02 01:41:11.597494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.597473    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.597652 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:11.597570    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n6jp" podUID="d4c9ad68-9361-49c7-a2a4-795175ab6159"
Jun 02 01:41:11.604444 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.604417    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9n6jp"]
Jun 02 01:41:11.742450 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.742420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-dbus\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.742599 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.742462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.742599 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.742587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-kubelet-config\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843266 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.843233    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-kubelet-config\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843430 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.843285    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-dbus\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843430 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.843317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-kubelet-config\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843430 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.843331    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843603 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:11.843470    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:11.843603 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:11.843476    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4c9ad68-9361-49c7-a2a4-795175ab6159-dbus\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:11.843603 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:11.843547    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret podName:d4c9ad68-9361-49c7-a2a4-795175ab6159 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:12.343528278 +0000 UTC m=+31.720779796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret") pod "global-pull-secret-syncer-9n6jp" (UID: "d4c9ad68-9361-49c7-a2a4-795175ab6159") : object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:12.340863 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:12.340835    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:12.341116 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:12.340975    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n6jp" podUID="d4c9ad68-9361-49c7-a2a4-795175ab6159"
Jun 02 01:41:12.347051 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:12.347026    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:12.347213 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:12.347194    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:12.347281 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:12.347266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret podName:d4c9ad68-9361-49c7-a2a4-795175ab6159 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:13.347244824 +0000 UTC m=+32.724496344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret") pod "global-pull-secret-syncer-9n6jp" (UID: "d4c9ad68-9361-49c7-a2a4-795175ab6159") : object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:13.153421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:13.153387    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:13.153890 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:13.153400    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:13.153890 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.153532    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:41:13.153890 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.153576    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94mpp" podUID="479f7208-52f1-41e4-b555-d1004bffdfdd"
Jun 02 01:41:13.353738 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:13.353705    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:13.353902 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.353873    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:13.353946 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.353938    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret podName:d4c9ad68-9361-49c7-a2a4-795175ab6159 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.353921588 +0000 UTC m=+34.731173108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret") pod "global-pull-secret-syncer-9n6jp" (UID: "d4c9ad68-9361-49c7-a2a4-795175ab6159") : object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:13.856768 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:13.856736    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:13.856923 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.856860    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:41:13.856923 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.856920    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:41:45.856905244 +0000 UTC m=+65.234156755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:41:13.958185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:13.958006    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:13.958303 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.958145    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:41:13.958303 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.958278    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:41:13.958303 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.958288    2562 projected.go:194] Error preparing data for projected volume kube-api-access-hn8tq for pod openshift-network-diagnostics/network-check-target-94mpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:41:13.958441 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:13.958345    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq podName:479f7208-52f1-41e4-b555-d1004bffdfdd nodeName:}" failed. No retries permitted until 2026-06-02 01:41:45.958325134 +0000 UTC m=+65.335576676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hn8tq" (UniqueName: "kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq") pod "network-check-target-94mpp" (UID: "479f7208-52f1-41e4-b555-d1004bffdfdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:41:14.152670 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.152593    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:14.152828 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.152717    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n6jp" podUID="d4c9ad68-9361-49c7-a2a4-795175ab6159"
Jun 02 01:41:14.435343 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.435279    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-109.ec2.internal" event="NodeReady"
Jun 02 01:41:14.435728 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.435405    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 02 01:41:14.468340 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.468220    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4988d578-sctgr"]
Jun 02 01:41:14.493047 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.493024    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gnwvv"]
Jun 02 01:41:14.493215 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.493191    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.496656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.496398    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4h6ct\""
Jun 02 01:41:14.496656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.496398    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 02 01:41:14.496656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.496440    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 02 01:41:14.496656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.496399    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 02 01:41:14.502281 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.502070    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 02 01:41:14.507028 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.507008    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghlkg"]
Jun 02 01:41:14.507422 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.507406    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.511090 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.511067    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q2kdm\""
Jun 02 01:41:14.511201 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.511183    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 02 01:41:14.511295 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.511279    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 02 01:41:14.525216 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.525163    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4988d578-sctgr"]
Jun 02 01:41:14.525301 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.525226    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gnwvv"]
Jun 02 01:41:14.525301 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.525240    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghlkg"]
Jun 02 01:41:14.525301 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.525270    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:14.528568 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.528529    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kzbv\""
Jun 02 01:41:14.528568 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.528560    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 02 01:41:14.528730 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.528571    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 02 01:41:14.528730 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.528608    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 02 01:41:14.663789 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.663762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.663789 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.663794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664015 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.663929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664015 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.663972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664015 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkpg\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/355f7a90-9071-49a0-82ea-5424317090dc-config-volume\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.664168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8nd5\" (UniqueName: \"kubernetes.io/projected/355f7a90-9071-49a0-82ea-5424317090dc-kube-api-access-m8nd5\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.664311 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct68w\" (UniqueName: \"kubernetes.io/projected/6d57f3a2-84e1-4d01-9654-cc21b15f5293-kube-api-access-ct68w\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:14.664311 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.664311 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.664446 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355f7a90-9071-49a0-82ea-5424317090dc-tmp-dir\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.664446 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:14.664446 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.664375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.764750 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764719    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764761    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764792    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355f7a90-9071-49a0-82ea-5424317090dc-tmp-dir\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764815    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764844    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764869    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.764909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764896    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.764921    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764944    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.764964    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.764996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.264973423 +0000 UTC m=+34.642224930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765021    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkpg\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765055    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/355f7a90-9071-49a0-82ea-5424317090dc-config-volume\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765082    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.765097    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765107    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8nd5\" (UniqueName: \"kubernetes.io/projected/355f7a90-9071-49a0-82ea-5424317090dc-kube-api-access-m8nd5\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.765117    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765134    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct68w\" (UniqueName: \"kubernetes.io/projected/6d57f3a2-84e1-4d01-9654-cc21b15f5293-kube-api-access-ct68w\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/355f7a90-9071-49a0-82ea-5424317090dc-tmp-dir\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.765137    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.765179    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.265164304 +0000 UTC m=+34.642415824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:14.765249 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:14.765208    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.265198579 +0000 UTC m=+34.642450097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:14.766028 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.766028 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.765843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/355f7a90-9071-49a0-82ea-5424317090dc-config-volume\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.766028 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.766007    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.766165 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.766141    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.769494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.769470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.769627 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.769519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.774654 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.774628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8nd5\" (UniqueName: \"kubernetes.io/projected/355f7a90-9071-49a0-82ea-5424317090dc-kube-api-access-m8nd5\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:14.774765 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.774687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkpg\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.774875 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.774831    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:14.775223 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:14.775199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct68w\" (UniqueName: \"kubernetes.io/projected/6d57f3a2-84e1-4d01-9654-cc21b15f5293-kube-api-access-ct68w\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:15.157070 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.156999    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:15.157070 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.157046    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:15.160314 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.160288    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 01:41:15.160491 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.160474    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hbws\""
Jun 02 01:41:15.160614 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.160577    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 02 01:41:15.160673 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.160576    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 02 01:41:15.160673 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.160626    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnph6\""
Jun 02 01:41:15.268789 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.268748    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:15.268959 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.268796    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:15.268959 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.268840    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:15.268959 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.268917    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.268966    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.268997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:16.268975372 +0000 UTC m=+35.646226895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.269017    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:16.269006585 +0000 UTC m=+35.646258110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.269049    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.269060    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:15.269160 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.269091    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:16.269079601 +0000 UTC m=+35.646331115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:15.369240 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:15.369209    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:15.369394 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.369364    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:15.369435 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:15.369419    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret podName:d4c9ad68-9361-49c7-a2a4-795175ab6159 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:19.369403582 +0000 UTC m=+38.746655099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret") pod "global-pull-secret-syncer-9n6jp" (UID: "d4c9ad68-9361-49c7-a2a4-795175ab6159") : object "kube-system"/"original-pull-secret" not registered
Jun 02 01:41:16.152883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:16.152847    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:16.156228 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:16.156207    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 02 01:41:16.276582 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:16.276552    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:16.276582 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:16.276584    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:16.276748 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:16.276609    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:16.276748 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276703    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:16.276748 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276716    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:16.276748 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276729    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:16.276873 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276704    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:16.276873 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276764    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:18.276750752 +0000 UTC m=+37.654002259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:16.276873 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276778    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:18.276772399 +0000 UTC m=+37.654023906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:16.276873 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:16.276788    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:18.276782866 +0000 UTC m=+37.654034372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:17.351421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:17.351391    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="d5403289f1cdcab39bdf22bbcbd3312aafd691731662efbcc1c7d554878cd4d7" exitCode=0
Jun 02 01:41:17.351995 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:17.351437    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"d5403289f1cdcab39bdf22bbcbd3312aafd691731662efbcc1c7d554878cd4d7"}
Jun 02 01:41:18.289494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:18.289463    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:18.289511    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:18.289540    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289598    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289621    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289650    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289656    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:22.289638722 +0000 UTC m=+41.666890229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289661    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:18.289687 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289687    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:22.289670403 +0000 UTC m=+41.666921918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:18.289960 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:18.289706    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:22.289696727 +0000 UTC m=+41.666948233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:18.356061 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:18.356034    2562 generic.go:358] "Generic (PLEG): container finished" podID="0b228450-b6c0-44b8-945d-b44fc950d2e9" containerID="64f2a30f146cf6e64c28e5e7dc770ade26b05f4675f3fe927c055ffc3555838e" exitCode=0
Jun 02 01:41:18.356531 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:18.356082    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerDied","Data":"64f2a30f146cf6e64c28e5e7dc770ade26b05f4675f3fe927c055ffc3555838e"}
Jun 02 01:41:19.360821 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.360595    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" event={"ID":"0b228450-b6c0-44b8-945d-b44fc950d2e9","Type":"ContainerStarted","Data":"2c8ebbf31d9e40ee6a8d1b04d7fdc44fce0ec6084af0e543d792d0cab9eb28bf"}
Jun 02 01:41:19.384951 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.384909    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zzbhj" podStartSLOduration=4.590515207 podStartE2EDuration="38.38489746s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:40:42.510239857 +0000 UTC m=+1.887491363" lastFinishedPulling="2026-06-02 01:41:16.304622104 +0000 UTC m=+35.681873616" observedRunningTime="2026-06-02 01:41:19.384618924 +0000 UTC m=+38.761870457" watchObservedRunningTime="2026-06-02 01:41:19.38489746 +0000 UTC m=+38.762148989"
Jun 02 01:41:19.397796 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.397773    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:19.400346 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.400326    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4c9ad68-9361-49c7-a2a4-795175ab6159-original-pull-secret\") pod \"global-pull-secret-syncer-9n6jp\" (UID: \"d4c9ad68-9361-49c7-a2a4-795175ab6159\") " pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:19.460803 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.460782    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n6jp"
Jun 02 01:41:19.620274 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:19.620193    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9n6jp"]
Jun 02 01:41:19.623886 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:41:19.623859    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c9ad68_9361_49c7_a2a4_795175ab6159.slice/crio-32ca3fc544e309eff406c435a86bd4a1275e09fe1b09892bba5818fdfa30b93d WatchSource:0}: Error finding container 32ca3fc544e309eff406c435a86bd4a1275e09fe1b09892bba5818fdfa30b93d: Status 404 returned error can't find the container with id 32ca3fc544e309eff406c435a86bd4a1275e09fe1b09892bba5818fdfa30b93d
Jun 02 01:41:20.363253 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:20.363217    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9n6jp" event={"ID":"d4c9ad68-9361-49c7-a2a4-795175ab6159","Type":"ContainerStarted","Data":"32ca3fc544e309eff406c435a86bd4a1275e09fe1b09892bba5818fdfa30b93d"}
Jun 02 01:41:22.319722 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:22.319684    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:22.319722 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:22.319724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:22.319750    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319831    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319837    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319837    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319921    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:30.319899263 +0000 UTC m=+49.697150770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319843    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319941    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:30.319931738 +0000 UTC m=+49.697183246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:22.320195 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:22.319964    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:30.319949596 +0000 UTC m=+49.697201104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:25.372538 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:25.372489    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9n6jp" event={"ID":"d4c9ad68-9361-49c7-a2a4-795175ab6159","Type":"ContainerStarted","Data":"a2658a78d04a6d349cdfdbe3ec8a07840dfdbd0ceb55483addacffa682fb05e6"}
Jun 02 01:41:25.390359 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:25.389090    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9n6jp" podStartSLOduration=9.28299246 podStartE2EDuration="14.389073614s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:19.626096903 +0000 UTC m=+39.003348410" lastFinishedPulling="2026-06-02 01:41:24.732178054 +0000 UTC m=+44.109429564" observedRunningTime="2026-06-02 01:41:25.387821981 +0000 UTC m=+44.765073506" watchObservedRunningTime="2026-06-02 01:41:25.389073614 +0000 UTC m=+44.766325146"
Jun 02 01:41:30.377784 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:30.377747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:30.377784 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:30.377790    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:30.377828    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.377890    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.377951    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:41:46.377933786 +0000 UTC m=+65.755185298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.377956    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.377985    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.377999    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.378007    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:46.377993548 +0000 UTC m=+65.755245055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:30.378269 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:30.378047    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:46.37803404 +0000 UTC m=+65.755285548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:41.349175 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:41.349148    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cg9l"
Jun 02 01:41:45.881181 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:45.881136    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:41:45.884052 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:45.884031    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 01:41:45.891350 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:45.891324    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 02 01:41:45.891469 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:45.891392    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:42:49.891376446 +0000 UTC m=+129.268627953 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : secret "metrics-daemon-secret" not found
Jun 02 01:41:45.981990 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:45.981961    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:45.985083 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:45.985067    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 02 01:41:45.995044 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:45.995026    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 02 01:41:46.006379 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.006356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8tq\" (UniqueName: \"kubernetes.io/projected/479f7208-52f1-41e4-b555-d1004bffdfdd-kube-api-access-hn8tq\") pod \"network-check-target-94mpp\" (UID: \"479f7208-52f1-41e4-b555-d1004bffdfdd\") " pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:46.077108 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.077086    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnph6\""
Jun 02 01:41:46.084577 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.084561    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:46.203389 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.203362    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94mpp"]
Jun 02 01:41:46.206407 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:41:46.206383    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479f7208_52f1_41e4_b555_d1004bffdfdd.slice/crio-213fcb48d4b4223aebfe3bf75643df38c16355c67c48b7cb8d38f5551dde61d1 WatchSource:0}: Error finding container 213fcb48d4b4223aebfe3bf75643df38c16355c67c48b7cb8d38f5551dde61d1: Status 404 returned error can't find the container with id 213fcb48d4b4223aebfe3bf75643df38c16355c67c48b7cb8d38f5551dde61d1
Jun 02 01:41:46.385733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.385653    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:41:46.385733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.385688    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:41:46.385733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.385715    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385799    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385856    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385877    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:42:18.385855393 +0000 UTC m=+97.763106919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385900    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385914    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385929    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:42:18.385910981 +0000 UTC m=+97.763162505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:41:46.385979 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:41:46.385946    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:42:18.385936079 +0000 UTC m=+97.763187586 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:41:46.410233 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:46.410208    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94mpp" event={"ID":"479f7208-52f1-41e4-b555-d1004bffdfdd","Type":"ContainerStarted","Data":"213fcb48d4b4223aebfe3bf75643df38c16355c67c48b7cb8d38f5551dde61d1"}
Jun 02 01:41:49.417574 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:49.417538    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94mpp" event={"ID":"479f7208-52f1-41e4-b555-d1004bffdfdd","Type":"ContainerStarted","Data":"1707aea508626af82c9b9bd009a845254ccbbad04ddb1ebc1b3335cf6324b4cf"}
Jun 02 01:41:49.417962 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:49.417689    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:41:49.433238 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:49.433177    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94mpp" podStartSLOduration=65.421319727 podStartE2EDuration="1m8.433162769s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:41:46.208449976 +0000 UTC m=+65.585701487" lastFinishedPulling="2026-06-02 01:41:49.220293022 +0000 UTC m=+68.597544529" observedRunningTime="2026-06-02 01:41:49.432736924 +0000 UTC m=+68.809988453" watchObservedRunningTime="2026-06-02 01:41:49.433162769 +0000 UTC m=+68.810414292"
Jun 02 01:41:56.452897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.452862    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"]
Jun 02 01:41:56.454715 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.454699    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.457601 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.457579    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 02 01:41:56.457711 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.457581    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 02 01:41:56.458978 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.458962    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 02 01:41:56.459065 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.459005    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 02 01:41:56.463901 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.463879    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"]
Jun 02 01:41:56.566020 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.565986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs256\" (UniqueName: \"kubernetes.io/projected/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-kube-api-access-cs256\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.566168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.566031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-tmp\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.566168 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.566098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-klusterlet-config\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.666638 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.666602    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-klusterlet-config\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.666774 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.666688    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs256\" (UniqueName: \"kubernetes.io/projected/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-kube-api-access-cs256\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.666774 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.666736    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-tmp\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.667110 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.667089    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-tmp\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.669019 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.669003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-klusterlet-config\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.674834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.674809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs256\" (UniqueName: \"kubernetes.io/projected/08eecfa1-b69c-4edc-bbbf-e74bdfa87497-kube-api-access-cs256\") pod \"klusterlet-addon-workmgr-77687bc6b8-xghxh\" (UID: \"08eecfa1-b69c-4edc-bbbf-e74bdfa87497\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.763395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.763373    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:41:56.878810 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:56.878777    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"]
Jun 02 01:41:56.882892 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:41:56.882864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08eecfa1_b69c_4edc_bbbf_e74bdfa87497.slice/crio-199b6e7a242d6e2b9d459e3d04e8c784b861188c5d5e318edd8c4d4725c03cd3 WatchSource:0}: Error finding container 199b6e7a242d6e2b9d459e3d04e8c784b861188c5d5e318edd8c4d4725c03cd3: Status 404 returned error can't find the container with id 199b6e7a242d6e2b9d459e3d04e8c784b861188c5d5e318edd8c4d4725c03cd3
Jun 02 01:41:57.432339 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:41:57.432302    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" event={"ID":"08eecfa1-b69c-4edc-bbbf-e74bdfa87497","Type":"ContainerStarted","Data":"199b6e7a242d6e2b9d459e3d04e8c784b861188c5d5e318edd8c4d4725c03cd3"}
Jun 02 01:42:03.445571 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:03.445536    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" event={"ID":"08eecfa1-b69c-4edc-bbbf-e74bdfa87497","Type":"ContainerStarted","Data":"108e130a9960ba59a6f05b729e9ec50a71f1381c33680dd7a249c2b1d56c585d"}
Jun 02 01:42:03.446027 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:03.445738    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:42:03.447362 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:03.447340    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:42:03.463994 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:03.463951    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" podStartSLOduration=1.697133997 podStartE2EDuration="7.463938378s" podCreationTimestamp="2026-06-02 01:41:56 +0000 UTC" firstStartedPulling="2026-06-02 01:41:56.88447991 +0000 UTC m=+76.261731419" lastFinishedPulling="2026-06-02 01:42:02.651284292 +0000 UTC m=+82.028535800" observedRunningTime="2026-06-02 01:42:03.463029372 +0000 UTC m=+82.840280898" watchObservedRunningTime="2026-06-02 01:42:03.463938378 +0000 UTC m=+82.841189908"
Jun 02 01:42:18.430682 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:18.430648    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:42:18.430682 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:18.430684    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:42:18.431083 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:18.430709    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:42:18.431083 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.430822    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:42:18.431083 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.430833    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:42:18.431083 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.430835    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:42:18.434002 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.431365    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:22.430888376 +0000 UTC m=+161.808139886 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:42:18.434002 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.431403    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:22.431388669 +0000 UTC m=+161.808640181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:42:18.434002 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.431448    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:42:18.434002 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:18.431528    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:43:22.431493345 +0000 UTC m=+161.808744853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:42:20.422478 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:20.422451    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94mpp"
Jun 02 01:42:49.947555 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:42:49.947483    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:42:49.948035 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:49.947649    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 02 01:42:49.948035 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:42:49.947727    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs podName:be8a97ef-f733-469d-b072-d43918a0f0df nodeName:}" failed. No retries permitted until 2026-06-02 01:44:51.947708648 +0000 UTC m=+251.324960158 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs") pod "network-metrics-daemon-tb55s" (UID: "be8a97ef-f733-469d-b072-d43918a0f0df") : secret "metrics-daemon-secret" not found
Jun 02 01:43:13.675827 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.675792    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"]
Jun 02 01:43:13.677616 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.677600    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"
Jun 02 01:43:13.680435 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.680415    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ctsdk\""
Jun 02 01:43:13.682813 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.682792    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"]
Jun 02 01:43:13.684465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.684450    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.691796 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.691778    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 02 01:43:13.691872 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.691824    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hzhrr\""
Jun 02 01:43:13.692282 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.692269    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 02 01:43:13.694801 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.694788    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 02 01:43:13.695084 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.695071    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 02 01:43:13.699530 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.699495    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"]
Jun 02 01:43:13.701366 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.701348    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"]
Jun 02 01:43:13.711743 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.711723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5596ee6-3615-480f-b26e-d1ffc80969b6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.711829 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.711776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq7c5\" (UniqueName: \"kubernetes.io/projected/b5596ee6-3615-480f-b26e-d1ffc80969b6-kube-api-access-zq7c5\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.711868 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.711845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q58f\" (UniqueName: \"kubernetes.io/projected/20736953-724f-4198-81a1-ee08a9d5b676-kube-api-access-2q58f\") pod \"network-check-source-56d84b9f44-r2vbd\" (UID: \"20736953-724f-4198-81a1-ee08a9d5b676\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"
Jun 02 01:43:13.711909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.711872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.786441 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.786404    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ddxc8"]
Jun 02 01:43:13.788421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.788401    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.791370 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.791348    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 02 01:43:13.791476 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.791377    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 02 01:43:13.791476 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.791434    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 02 01:43:13.791579 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.791532    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 02 01:43:13.791619 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.791601    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jfjng\""
Jun 02 01:43:13.799087 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.799065    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 02 01:43:13.807366 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.807344    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ddxc8"]
Jun 02 01:43:13.812752 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-tmp\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.812875 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-serving-cert\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.812875 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.812875 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-service-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.813018 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-snapshots\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.813018 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812931    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5596ee6-3615-480f-b26e-d1ffc80969b6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.813018 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96mc\" (UniqueName: \"kubernetes.io/projected/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-kube-api-access-g96mc\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.813018 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.812996    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq7c5\" (UniqueName: \"kubernetes.io/projected/b5596ee6-3615-480f-b26e-d1ffc80969b6-kube-api-access-zq7c5\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.813277 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.813032    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q58f\" (UniqueName: \"kubernetes.io/projected/20736953-724f-4198-81a1-ee08a9d5b676-kube-api-access-2q58f\") pod \"network-check-source-56d84b9f44-r2vbd\" (UID: \"20736953-724f-4198-81a1-ee08a9d5b676\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"
Jun 02 01:43:13.813277 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.813227    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.813369 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:13.813330    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:13.813411 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:13.813397    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.313379706 +0000 UTC m=+153.690631214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:13.813737 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.813719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5596ee6-3615-480f-b26e-d1ffc80969b6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.830398 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.830365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq7c5\" (UniqueName: \"kubernetes.io/projected/b5596ee6-3615-480f-b26e-d1ffc80969b6-kube-api-access-zq7c5\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:13.830398 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.830393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q58f\" (UniqueName: \"kubernetes.io/projected/20736953-724f-4198-81a1-ee08a9d5b676-kube-api-access-2q58f\") pod \"network-check-source-56d84b9f44-r2vbd\" (UID: \"20736953-724f-4198-81a1-ee08a9d5b676\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"
Jun 02 01:43:13.913517 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g96mc\" (UniqueName: \"kubernetes.io/projected/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-kube-api-access-g96mc\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.913671 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913585    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-tmp\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.913671 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913604    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-serving-cert\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.913671 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913625    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.913671 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-service-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.913865 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.913678    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-snapshots\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.914286 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.914264    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-tmp\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.914371 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.914315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-service-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.914424 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.914364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-snapshots\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.914923 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.914901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.915871 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.915855    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-serving-cert\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.921442 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.921410    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96mc\" (UniqueName: \"kubernetes.io/projected/1b86b8cd-614d-4e37-aa02-70aa09c53e2d-kube-api-access-g96mc\") pod \"insights-operator-788bf58df5-ddxc8\" (UID: \"1b86b8cd-614d-4e37-aa02-70aa09c53e2d\") " pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:13.986570 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:13.986528    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"
Jun 02 01:43:14.096972 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.096943    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-ddxc8"
Jun 02 01:43:14.100574 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.100548    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd"]
Jun 02 01:43:14.104365 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:14.104335    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20736953_724f_4198_81a1_ee08a9d5b676.slice/crio-b0ebdd83c12f59bbfc1c16cd0d5a0aad5d8d81c12d52025d43d7522237feb219 WatchSource:0}: Error finding container b0ebdd83c12f59bbfc1c16cd0d5a0aad5d8d81c12d52025d43d7522237feb219: Status 404 returned error can't find the container with id b0ebdd83c12f59bbfc1c16cd0d5a0aad5d8d81c12d52025d43d7522237feb219
Jun 02 01:43:14.221551 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.221521    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ddxc8"]
Jun 02 01:43:14.224452 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:14.224429    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b86b8cd_614d_4e37_aa02_70aa09c53e2d.slice/crio-2360133fcc755a7ebd1fc6ca30e04740b47860b90bcdb972947c3786e69e0153 WatchSource:0}: Error finding container 2360133fcc755a7ebd1fc6ca30e04740b47860b90bcdb972947c3786e69e0153: Status 404 returned error can't find the container with id 2360133fcc755a7ebd1fc6ca30e04740b47860b90bcdb972947c3786e69e0153
Jun 02 01:43:14.316858 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.316779    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:14.317000 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:14.316918    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:14.317000 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:14.316980    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.316964577 +0000 UTC m=+154.694216088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:14.575040 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.574947    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ddxc8" event={"ID":"1b86b8cd-614d-4e37-aa02-70aa09c53e2d","Type":"ContainerStarted","Data":"2360133fcc755a7ebd1fc6ca30e04740b47860b90bcdb972947c3786e69e0153"}
Jun 02 01:43:14.576081 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.576055    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd" event={"ID":"20736953-724f-4198-81a1-ee08a9d5b676","Type":"ContainerStarted","Data":"d01b57abb0b360aaa7f39119bb456cbd0cb6037dd547f4d102cf9eb0435a15e6"}
Jun 02 01:43:14.576081 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.576083    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd" event={"ID":"20736953-724f-4198-81a1-ee08a9d5b676","Type":"ContainerStarted","Data":"b0ebdd83c12f59bbfc1c16cd0d5a0aad5d8d81c12d52025d43d7522237feb219"}
Jun 02 01:43:14.592318 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:14.592279    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-r2vbd" podStartSLOduration=1.5922684089999999 podStartE2EDuration="1.592268409s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:43:14.591241064 +0000 UTC m=+153.968492593" watchObservedRunningTime="2026-06-02 01:43:14.592268409 +0000 UTC m=+153.969519938"
Jun 02 01:43:15.325237 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:15.325190    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:15.325655 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:15.325359    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:15.325655 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:15.325444    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.325421949 +0000 UTC m=+156.702673459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:16.582582 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:16.582550    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ddxc8" event={"ID":"1b86b8cd-614d-4e37-aa02-70aa09c53e2d","Type":"ContainerStarted","Data":"05f091b58f24a5895742a50d1ac01bb9a5fc45353ecc802d2209398aa8ca73e1"}
Jun 02 01:43:16.599395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:16.599346    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-ddxc8" podStartSLOduration=1.679297467 podStartE2EDuration="3.599330007s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:14.22802902 +0000 UTC m=+153.605280527" lastFinishedPulling="2026-06-02 01:43:16.148061549 +0000 UTC m=+155.525313067" observedRunningTime="2026-06-02 01:43:16.599220925 +0000 UTC m=+155.976472450" watchObservedRunningTime="2026-06-02 01:43:16.599330007 +0000 UTC m=+155.976581537"
Jun 02 01:43:17.343234 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:17.343197    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:17.343389 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:17.343345    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:17.343434 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:17.343409    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.343393635 +0000 UTC m=+160.720645145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:17.507128 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:17.507092    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b4988d578-sctgr" podUID="8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"
Jun 02 01:43:17.519226 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:17.519197    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gnwvv" podUID="355f7a90-9071-49a0-82ea-5424317090dc"
Jun 02 01:43:17.540686 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:17.540651    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ghlkg" podUID="6d57f3a2-84e1-4d01-9654-cc21b15f5293"
Jun 02 01:43:17.585657 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:17.585625    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:43:17.585657 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:17.585643    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:43:17.585657 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:17.585625    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:43:18.168734 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:18.168687    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tb55s" podUID="be8a97ef-f733-469d-b072-d43918a0f0df"
Jun 02 01:43:19.131678 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.131655    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrrrf_3c31d2b1-dc03-4e5e-ac40-26dcc7605448/dns-node-resolver/0.log"
Jun 02 01:43:19.287052 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.287018    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"]
Jun 02 01:43:19.289848 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.289832    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"
Jun 02 01:43:19.292794 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.292769    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 02 01:43:19.292794 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.292769    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 02 01:43:19.294247 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.294228    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wktjk\""
Jun 02 01:43:19.299456 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.299432    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"]
Jun 02 01:43:19.357782 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.357706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzs4\" (UniqueName: \"kubernetes.io/projected/dbbc1644-e11a-4501-a0ec-1692290bacb9-kube-api-access-njzs4\") pod \"migrator-96c6f749-dc2x8\" (UID: \"dbbc1644-e11a-4501-a0ec-1692290bacb9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"
Jun 02 01:43:19.458393 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.458352    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njzs4\" (UniqueName: \"kubernetes.io/projected/dbbc1644-e11a-4501-a0ec-1692290bacb9-kube-api-access-njzs4\") pod \"migrator-96c6f749-dc2x8\" (UID: \"dbbc1644-e11a-4501-a0ec-1692290bacb9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"
Jun 02 01:43:19.467031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.467005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzs4\" (UniqueName: \"kubernetes.io/projected/dbbc1644-e11a-4501-a0ec-1692290bacb9-kube-api-access-njzs4\") pod \"migrator-96c6f749-dc2x8\" (UID: \"dbbc1644-e11a-4501-a0ec-1692290bacb9\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"
Jun 02 01:43:19.598850 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.598822    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"
Jun 02 01:43:19.714206 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:19.714173    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8"]
Jun 02 01:43:19.717044 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:19.717015    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbc1644_e11a_4501_a0ec_1692290bacb9.slice/crio-26d5442cf4cdc0bedd34e0f4775e0cb124e0409b03443dc67d505d26bf8666db WatchSource:0}: Error finding container 26d5442cf4cdc0bedd34e0f4775e0cb124e0409b03443dc67d505d26bf8666db: Status 404 returned error can't find the container with id 26d5442cf4cdc0bedd34e0f4775e0cb124e0409b03443dc67d505d26bf8666db
Jun 02 01:43:20.531876 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:20.531851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xlzh6_0f765a2e-2911-4391-8e7f-5ef7d59726eb/node-ca/0.log"
Jun 02 01:43:20.593161 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:20.593127    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8" event={"ID":"dbbc1644-e11a-4501-a0ec-1692290bacb9","Type":"ContainerStarted","Data":"26d5442cf4cdc0bedd34e0f4775e0cb124e0409b03443dc67d505d26bf8666db"}
Jun 02 01:43:21.374152 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:21.374118    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:21.374327 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:21.374268    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:21.374378 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:21.374334    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.374319074 +0000 UTC m=+168.751570581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:21.597093 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:21.597062    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8" event={"ID":"dbbc1644-e11a-4501-a0ec-1692290bacb9","Type":"ContainerStarted","Data":"bd37b4ce86240da15a0e8daad1a87f550b720a7d34da25c3bbfb7be139d93d74"}
Jun 02 01:43:21.597093 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:21.597098    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8" event={"ID":"dbbc1644-e11a-4501-a0ec-1692290bacb9","Type":"ContainerStarted","Data":"bb84ea59ecfc74dba8f76c3b997971f5dba20765b61e7ebc34ec5411a66bc387"}
Jun 02 01:43:21.614970 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:21.614925    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dc2x8" podStartSLOduration=1.373936303 podStartE2EDuration="2.614912148s" podCreationTimestamp="2026-06-02 01:43:19 +0000 UTC" firstStartedPulling="2026-06-02 01:43:19.718883067 +0000 UTC m=+159.096134579" lastFinishedPulling="2026-06-02 01:43:20.959858913 +0000 UTC m=+160.337110424" observedRunningTime="2026-06-02 01:43:21.614019222 +0000 UTC m=+160.991270751" watchObservedRunningTime="2026-06-02 01:43:21.614912148 +0000 UTC m=+160.992163713"
Jun 02 01:43:22.482130 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:22.482091    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:43:22.482130 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:22.482132    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") pod \"image-registry-7b4988d578-sctgr\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") " pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:22.482170    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482237    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482253    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482279    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482294    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4988d578-sctgr: secret "image-registry-tls" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482299    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert podName:6d57f3a2-84e1-4d01-9654-cc21b15f5293 nodeName:}" failed. No retries permitted until 2026-06-02 01:45:24.482285038 +0000 UTC m=+283.859536545 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert") pod "ingress-canary-ghlkg" (UID: "6d57f3a2-84e1-4d01-9654-cc21b15f5293") : secret "canary-serving-cert" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482313    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls podName:355f7a90-9071-49a0-82ea-5424317090dc nodeName:}" failed. No retries permitted until 2026-06-02 01:45:24.482307705 +0000 UTC m=+283.859559212 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls") pod "dns-default-gnwvv" (UID: "355f7a90-9071-49a0-82ea-5424317090dc") : secret "dns-default-metrics-tls" not found
Jun 02 01:43:22.482330 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:22.482329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls podName:8a5a6b6b-7ad9-482b-b0b7-4eca337c3424 nodeName:}" failed. No retries permitted until 2026-06-02 01:45:24.482317834 +0000 UTC m=+283.859569342 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls") pod "image-registry-7b4988d578-sctgr" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424") : secret "image-registry-tls" not found
Jun 02 01:43:29.435935 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:29.435902    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:29.436300 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:29.436017    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:29.436300 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:43:29.436067    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls podName:b5596ee6-3615-480f-b26e-d1ffc80969b6 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:45.436053325 +0000 UTC m=+184.813304837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-6wg4z" (UID: "b5596ee6-3615-480f-b26e-d1ffc80969b6") : secret "cluster-monitoring-operator-tls" not found
Jun 02 01:43:32.153051 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:32.153009    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:43:38.170770 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.170733    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hmlp4"]
Jun 02 01:43:38.173753 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.173731    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.176808 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.176788    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 02 01:43:38.176912 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.176833    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 02 01:43:38.178534 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.178518    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qqcg\""
Jun 02 01:43:38.186151 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.186124    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmlp4"]
Jun 02 01:43:38.187190 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.187172    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-kcrtl"]
Jun 02 01:43:38.189416 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.189399    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:38.192802 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.192786    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 02 01:43:38.192892 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.192827    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 02 01:43:38.192951 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.192922    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zr428\""
Jun 02 01:43:38.200393 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.200374    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-kcrtl"]
Jun 02 01:43:38.303995 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.303966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0da028a-7900-4cd5-beaa-cf84f5895851-data-volume\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.304142 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.304057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpgf\" (UniqueName: \"kubernetes.io/projected/c255a191-6662-48a5-8772-fb5eff7bc275-kube-api-access-nfpgf\") pod \"downloads-c65b8dc4b-kcrtl\" (UID: \"c255a191-6662-48a5-8772-fb5eff7bc275\") " pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:38.304142 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.304087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0da028a-7900-4cd5-beaa-cf84f5895851-crio-socket\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.304142 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.304113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0da028a-7900-4cd5-beaa-cf84f5895851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.304304 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.304149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-api-access-lc4fb\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.304304 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.304194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.404952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.404922    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0da028a-7900-4cd5-beaa-cf84f5895851-crio-socket\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.404952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.404954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0da028a-7900-4cd5-beaa-cf84f5895851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405156 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.404983    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-api-access-lc4fb\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405156 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405003    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405156 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405032    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0da028a-7900-4cd5-beaa-cf84f5895851-crio-socket\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405156 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405093    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0da028a-7900-4cd5-beaa-cf84f5895851-data-volume\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405302 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405176    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpgf\" (UniqueName: \"kubernetes.io/projected/c255a191-6662-48a5-8772-fb5eff7bc275-kube-api-access-nfpgf\") pod \"downloads-c65b8dc4b-kcrtl\" (UID: \"c255a191-6662-48a5-8772-fb5eff7bc275\") " pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:38.405428 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0da028a-7900-4cd5-beaa-cf84f5895851-data-volume\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.405636 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.405619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.407235 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.407219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0da028a-7900-4cd5-beaa-cf84f5895851-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.414164 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.414145    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc4fb\" (UniqueName: \"kubernetes.io/projected/b0da028a-7900-4cd5-beaa-cf84f5895851-kube-api-access-lc4fb\") pod \"insights-runtime-extractor-hmlp4\" (UID: \"b0da028a-7900-4cd5-beaa-cf84f5895851\") " pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.414619 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.414603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpgf\" (UniqueName: \"kubernetes.io/projected/c255a191-6662-48a5-8772-fb5eff7bc275-kube-api-access-nfpgf\") pod \"downloads-c65b8dc4b-kcrtl\" (UID: \"c255a191-6662-48a5-8772-fb5eff7bc275\") " pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:38.482252 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.482233    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmlp4"
Jun 02 01:43:38.497364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.497342    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:38.610668 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.610642    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmlp4"]
Jun 02 01:43:38.613977 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:38.613953    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0da028a_7900_4cd5_beaa_cf84f5895851.slice/crio-6075ee1726b94f1dae3084e612e516dbec99b5f2f44fb265d0b42ebb5e2a1a3e WatchSource:0}: Error finding container 6075ee1726b94f1dae3084e612e516dbec99b5f2f44fb265d0b42ebb5e2a1a3e: Status 404 returned error can't find the container with id 6075ee1726b94f1dae3084e612e516dbec99b5f2f44fb265d0b42ebb5e2a1a3e
Jun 02 01:43:38.625494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.625473    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-kcrtl"]
Jun 02 01:43:38.627700 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:38.627678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc255a191_6662_48a5_8772_fb5eff7bc275.slice/crio-bbde1bec23a1a2bde7535a4cf7625facc998cfd8a2329a0b5fef1c860303b239 WatchSource:0}: Error finding container bbde1bec23a1a2bde7535a4cf7625facc998cfd8a2329a0b5fef1c860303b239: Status 404 returned error can't find the container with id bbde1bec23a1a2bde7535a4cf7625facc998cfd8a2329a0b5fef1c860303b239
Jun 02 01:43:38.636223 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.636191    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-kcrtl" event={"ID":"c255a191-6662-48a5-8772-fb5eff7bc275","Type":"ContainerStarted","Data":"bbde1bec23a1a2bde7535a4cf7625facc998cfd8a2329a0b5fef1c860303b239"}
Jun 02 01:43:38.637223 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:38.637201    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmlp4" event={"ID":"b0da028a-7900-4cd5-beaa-cf84f5895851","Type":"ContainerStarted","Data":"6075ee1726b94f1dae3084e612e516dbec99b5f2f44fb265d0b42ebb5e2a1a3e"}
Jun 02 01:43:39.641677 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:39.641593    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmlp4" event={"ID":"b0da028a-7900-4cd5-beaa-cf84f5895851","Type":"ContainerStarted","Data":"8c8487dd8a630db215616874fa4bc877ef535bc4c99f2b682d233f9b2fee692b"}
Jun 02 01:43:39.641677 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:39.641626    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmlp4" event={"ID":"b0da028a-7900-4cd5-beaa-cf84f5895851","Type":"ContainerStarted","Data":"7ecd517fce58d5ff0339a8c117da1e8d337e8c74576c094ea59435ea63bc3b2e"}
Jun 02 01:43:41.648250 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:41.648202    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmlp4" event={"ID":"b0da028a-7900-4cd5-beaa-cf84f5895851","Type":"ContainerStarted","Data":"14a6a7aeba44c847db133c9b1b35632ad8f7202e13bc5f22a437e75bbf2a2531"}
Jun 02 01:43:41.667596 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:41.667534    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hmlp4" podStartSLOduration=1.281218081 podStartE2EDuration="3.667492443s" podCreationTimestamp="2026-06-02 01:43:38 +0000 UTC" firstStartedPulling="2026-06-02 01:43:38.65941479 +0000 UTC m=+178.036666298" lastFinishedPulling="2026-06-02 01:43:41.045689148 +0000 UTC m=+180.422940660" observedRunningTime="2026-06-02 01:43:41.666186729 +0000 UTC m=+181.043438258" watchObservedRunningTime="2026-06-02 01:43:41.667492443 +0000 UTC m=+181.044743973"
Jun 02 01:43:45.465851 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.465816    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:45.468418 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.468393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5596ee6-3615-480f-b26e-d1ffc80969b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-6wg4z\" (UID: \"b5596ee6-3615-480f-b26e-d1ffc80969b6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:45.495514 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.495472    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hzhrr\""
Jun 02 01:43:45.503022 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.503002    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"
Jun 02 01:43:45.641270 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.641240    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z"]
Jun 02 01:43:45.644911 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:45.644882    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5596ee6_3615_480f_b26e_d1ffc80969b6.slice/crio-d315105c91bbf67ebdc0b244ece096a29d96ea75049a5b00a50e3ef190dbea67 WatchSource:0}: Error finding container d315105c91bbf67ebdc0b244ece096a29d96ea75049a5b00a50e3ef190dbea67: Status 404 returned error can't find the container with id d315105c91bbf67ebdc0b244ece096a29d96ea75049a5b00a50e3ef190dbea67
Jun 02 01:43:45.662323 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:45.662295    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z" event={"ID":"b5596ee6-3615-480f-b26e-d1ffc80969b6","Type":"ContainerStarted","Data":"d315105c91bbf67ebdc0b244ece096a29d96ea75049a5b00a50e3ef190dbea67"}
Jun 02 01:43:46.987667 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.987633    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:43:46.989940 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.989916    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:46.993299 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.993016    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kbb5h\""
Jun 02 01:43:46.993299 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.993280    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 02 01:43:46.993636 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.993331    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 02 01:43:46.994727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.994701    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 02 01:43:46.994865 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.994740    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 02 01:43:46.994865 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.994713    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 02 01:43:46.999812 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:46.999789    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:43:47.080476 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhrl\" (UniqueName: \"kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.080635 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.080635 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.080755 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.080755 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.080861 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.080773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.181992 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.181958    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182046    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182091    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182131    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhrl\" (UniqueName: \"kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182172    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182217    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182819 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182769    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.182957 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.182912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.183085 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.183061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.184827 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.184784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.185606 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.185584    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.191146 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.191103    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhrl\" (UniqueName: \"kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl\") pod \"console-5f94dcf6f7-ktpbw\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") " pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:47.302656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:47.302578    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:43:54.472285 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.472248    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:43:54.476791 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:54.476753    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef33155_e21e_4fa8_8123_8456c34ed40b.slice/crio-6c169e5b781132ca16f51b659070590368dbfcc02772a70596b2f5f7c5444e08 WatchSource:0}: Error finding container 6c169e5b781132ca16f51b659070590368dbfcc02772a70596b2f5f7c5444e08: Status 404 returned error can't find the container with id 6c169e5b781132ca16f51b659070590368dbfcc02772a70596b2f5f7c5444e08
Jun 02 01:43:54.688604 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.688522    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f94dcf6f7-ktpbw" event={"ID":"eef33155-e21e-4fa8-8123-8456c34ed40b","Type":"ContainerStarted","Data":"6c169e5b781132ca16f51b659070590368dbfcc02772a70596b2f5f7c5444e08"}
Jun 02 01:43:54.690095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.690066    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-kcrtl" event={"ID":"c255a191-6662-48a5-8772-fb5eff7bc275","Type":"ContainerStarted","Data":"3d18feefab4c4edc727dc47c2da57cb134b1712b58eba429f94234ea32740ccf"}
Jun 02 01:43:54.690367 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.690345    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:54.691749 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.691673    2562 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-kcrtl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" start-of-body=
Jun 02 01:43:54.691749 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.691727    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-kcrtl" podUID="c255a191-6662-48a5-8772-fb5eff7bc275" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused"
Jun 02 01:43:54.691955 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.691928    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z" event={"ID":"b5596ee6-3615-480f-b26e-d1ffc80969b6","Type":"ContainerStarted","Data":"0d77c8908f70c806fdc1fe1933b4fed5237601cd9a2e8de03a7b25eb75cf0658"}
Jun 02 01:43:54.706872 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.706820    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-kcrtl" podStartSLOduration=0.930680792 podStartE2EDuration="16.706804693s" podCreationTimestamp="2026-06-02 01:43:38 +0000 UTC" firstStartedPulling="2026-06-02 01:43:38.629289514 +0000 UTC m=+178.006541024" lastFinishedPulling="2026-06-02 01:43:54.405413404 +0000 UTC m=+193.782664925" observedRunningTime="2026-06-02 01:43:54.70577795 +0000 UTC m=+194.083029480" watchObservedRunningTime="2026-06-02 01:43:54.706804693 +0000 UTC m=+194.084056224"
Jun 02 01:43:54.721919 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.721867    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-6wg4z" podStartSLOduration=33.021408658 podStartE2EDuration="41.721850701s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:45.646961922 +0000 UTC m=+185.024213429" lastFinishedPulling="2026-06-02 01:43:54.34740396 +0000 UTC m=+193.724655472" observedRunningTime="2026-06-02 01:43:54.720822829 +0000 UTC m=+194.098074358" watchObservedRunningTime="2026-06-02 01:43:54.721850701 +0000 UTC m=+194.099102238"
Jun 02 01:43:54.852004 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.851968    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"]
Jun 02 01:43:54.854895 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.854873    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:54.857968 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.857947    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vp466\""
Jun 02 01:43:54.858129 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.858011    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 02 01:43:54.862296 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.862275    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"]
Jun 02 01:43:54.946089 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:54.945990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-5s597\" (UID: \"4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:55.046909 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.046870    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-5s597\" (UID: \"4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:55.049829 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.049801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-5s597\" (UID: \"4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:55.166481 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.166452    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:55.315480 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.315427    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"]
Jun 02 01:43:55.319694 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:43:55.319657    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbcda7a_ea35_4fa2_8a8c_bd788a30aa89.slice/crio-cc5e9cc5714bb6fdc205891ccbf6ac5ba296af9d6457be1ff54875bfa6f86cb3 WatchSource:0}: Error finding container cc5e9cc5714bb6fdc205891ccbf6ac5ba296af9d6457be1ff54875bfa6f86cb3: Status 404 returned error can't find the container with id cc5e9cc5714bb6fdc205891ccbf6ac5ba296af9d6457be1ff54875bfa6f86cb3
Jun 02 01:43:55.697298 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.697259    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597" event={"ID":"4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89","Type":"ContainerStarted","Data":"cc5e9cc5714bb6fdc205891ccbf6ac5ba296af9d6457be1ff54875bfa6f86cb3"}
Jun 02 01:43:55.714166 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:55.714139    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-kcrtl"
Jun 02 01:43:59.712260 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.712211    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f94dcf6f7-ktpbw" event={"ID":"eef33155-e21e-4fa8-8123-8456c34ed40b","Type":"ContainerStarted","Data":"75342ddd3db28b779444c9b7ca645941e22b21ff36ca711c08f5f06d7a2a18f3"}
Jun 02 01:43:59.713870 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.713838    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597" event={"ID":"4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89","Type":"ContainerStarted","Data":"4f4b182d8b84b9192e980e11fc56c31ab55cfb521a63c17070a13964e4e5c1b9"}
Jun 02 01:43:59.714048 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.714030    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:59.719352 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.719328    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597"
Jun 02 01:43:59.731091 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.731045    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f94dcf6f7-ktpbw" podStartSLOduration=9.233141177 podStartE2EDuration="13.73103138s" podCreationTimestamp="2026-06-02 01:43:46 +0000 UTC" firstStartedPulling="2026-06-02 01:43:54.478951575 +0000 UTC m=+193.856203082" lastFinishedPulling="2026-06-02 01:43:58.976841763 +0000 UTC m=+198.354093285" observedRunningTime="2026-06-02 01:43:59.729841524 +0000 UTC m=+199.107093078" watchObservedRunningTime="2026-06-02 01:43:59.73103138 +0000 UTC m=+199.108283321"
Jun 02 01:43:59.749413 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.749372    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-5s597" podStartSLOduration=2.4182428160000002 podStartE2EDuration="5.749360706s" podCreationTimestamp="2026-06-02 01:43:54 +0000 UTC" firstStartedPulling="2026-06-02 01:43:55.322341916 +0000 UTC m=+194.699593424" lastFinishedPulling="2026-06-02 01:43:58.653459793 +0000 UTC m=+198.030711314" observedRunningTime="2026-06-02 01:43:59.748730339 +0000 UTC m=+199.125981867" watchObservedRunningTime="2026-06-02 01:43:59.749360706 +0000 UTC m=+199.126612235"
Jun 02 01:43:59.918362 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.918327    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"]
Jun 02 01:43:59.934144 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.934115    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"]
Jun 02 01:43:59.934304 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.934225    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:43:59.937783 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.937481    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 02 01:43:59.937783 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.937484    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 02 01:43:59.937783 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.937492    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8c5wz\""
Jun 02 01:43:59.937783 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:43:59.937574    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 02 01:44:00.092682 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.092648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.092897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.092707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/226e6f20-37b0-462c-8d5a-de15f1ca0851-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.092897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.092760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbln\" (UniqueName: \"kubernetes.io/projected/226e6f20-37b0-462c-8d5a-de15f1ca0851-kube-api-access-vcbln\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.092897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.092810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.193741 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.193706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.193926 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.193757    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/226e6f20-37b0-462c-8d5a-de15f1ca0851-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.193926 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.193784    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbln\" (UniqueName: \"kubernetes.io/projected/226e6f20-37b0-462c-8d5a-de15f1ca0851-kube-api-access-vcbln\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.194036 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.193956    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.194558 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.194530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/226e6f20-37b0-462c-8d5a-de15f1ca0851-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.196478 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.196451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.196478 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.196473    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/226e6f20-37b0-462c-8d5a-de15f1ca0851-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.202030 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.202001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbln\" (UniqueName: \"kubernetes.io/projected/226e6f20-37b0-462c-8d5a-de15f1ca0851-kube-api-access-vcbln\") pod \"prometheus-operator-658bcd8bdf-xkbxc\" (UID: \"226e6f20-37b0-462c-8d5a-de15f1ca0851\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.244866 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.244834    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"
Jun 02 01:44:00.383563 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.383467    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc"]
Jun 02 01:44:00.717372 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:00.717284    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc" event={"ID":"226e6f20-37b0-462c-8d5a-de15f1ca0851","Type":"ContainerStarted","Data":"76cafa49bc3b08a386af5ee5ca3e7a0fd86b3f5b2254b8c689cdb201050113a3"}
Jun 02 01:44:02.724896 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:02.724848    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc" event={"ID":"226e6f20-37b0-462c-8d5a-de15f1ca0851","Type":"ContainerStarted","Data":"ddbdd19980b6e9ca5ac23d3a37170e362d329a9ea9e8bc7d43f651e16302c610"}
Jun 02 01:44:02.724896 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:02.724894    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc" event={"ID":"226e6f20-37b0-462c-8d5a-de15f1ca0851","Type":"ContainerStarted","Data":"b4517754c203eacfd9b439d3eb4b539062619ead00eac51bb04c4beaf0667c36"}
Jun 02 01:44:02.742751 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:02.742702    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xkbxc" podStartSLOduration=1.806805314 podStartE2EDuration="3.742686926s" podCreationTimestamp="2026-06-02 01:43:59 +0000 UTC" firstStartedPulling="2026-06-02 01:44:00.389593426 +0000 UTC m=+199.766844934" lastFinishedPulling="2026-06-02 01:44:02.325475038 +0000 UTC m=+201.702726546" observedRunningTime="2026-06-02 01:44:02.740331712 +0000 UTC m=+202.117583242" watchObservedRunningTime="2026-06-02 01:44:02.742686926 +0000 UTC m=+202.119938454"
Jun 02 01:44:03.446570 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:03.446520    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" podUID="08eecfa1-b69c-4edc-bbbf-e74bdfa87497" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jun 02 01:44:03.728490 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:03.728457    2562 generic.go:358] "Generic (PLEG): container finished" podID="08eecfa1-b69c-4edc-bbbf-e74bdfa87497" containerID="108e130a9960ba59a6f05b729e9ec50a71f1381c33680dd7a249c2b1d56c585d" exitCode=1
Jun 02 01:44:03.728958 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:03.728540    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" event={"ID":"08eecfa1-b69c-4edc-bbbf-e74bdfa87497","Type":"ContainerDied","Data":"108e130a9960ba59a6f05b729e9ec50a71f1381c33680dd7a249c2b1d56c585d"}
Jun 02 01:44:03.729025 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:03.728995    2562 scope.go:117] "RemoveContainer" containerID="108e130a9960ba59a6f05b729e9ec50a71f1381c33680dd7a249c2b1d56c585d"
Jun 02 01:44:04.290269 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.290242    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2tkzs"]
Jun 02 01:44:04.313778 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.313752    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.316600 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.316578    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-76pc2\""
Jun 02 01:44:04.317165 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.317149    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 02 01:44:04.318203 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.318184    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 02 01:44:04.318273 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.318233    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 02 01:44:04.328479 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-sys\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328597 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328597 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328597 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-wtmp\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328759 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92qs\" (UniqueName: \"kubernetes.io/projected/9241381e-ccc6-4810-8aac-e1641c647b11-kube-api-access-r92qs\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328759 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-root\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328759 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-textfile\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328878 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.328878 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.328840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-metrics-client-ca\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429405 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429370    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-sys\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429405 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429403    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429422    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429464    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-wtmp\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429477    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-sys\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429490    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r92qs\" (UniqueName: \"kubernetes.io/projected/9241381e-ccc6-4810-8aac-e1641c647b11-kube-api-access-r92qs\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429566    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-root\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429608    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-textfile\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429649 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429633    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429980 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:44:04.429667    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 02 01:44:04.429980 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:44:04.429724    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls podName:9241381e-ccc6-4810-8aac-e1641c647b11 nodeName:}" failed. No retries permitted until 2026-06-02 01:44:04.929705698 +0000 UTC m=+204.306957210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls") pod "node-exporter-2tkzs" (UID: "9241381e-ccc6-4810-8aac-e1641c647b11") : secret "node-exporter-tls" not found
Jun 02 01:44:04.429980 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-wtmp\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429980 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429666    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9241381e-ccc6-4810-8aac-e1641c647b11-root\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.429980 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.429796    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-metrics-client-ca\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.430188 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.430029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-textfile\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.430227 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.430191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.430268 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.430243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9241381e-ccc6-4810-8aac-e1641c647b11-metrics-client-ca\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.431793 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.431777    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.439578 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.439558    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92qs\" (UniqueName: \"kubernetes.io/projected/9241381e-ccc6-4810-8aac-e1641c647b11-kube-api-access-r92qs\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.732927 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.732898    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh" event={"ID":"08eecfa1-b69c-4edc-bbbf-e74bdfa87497","Type":"ContainerStarted","Data":"d215801ed9b5efcf10af0ff126d27067410c20020c999285e7810809fe887586"}
Jun 02 01:44:04.733345 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.733181    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:44:04.733731 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.733713    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77687bc6b8-xghxh"
Jun 02 01:44:04.933363 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.933332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:04.935577 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:04.935555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9241381e-ccc6-4810-8aac-e1641c647b11-node-exporter-tls\") pod \"node-exporter-2tkzs\" (UID: \"9241381e-ccc6-4810-8aac-e1641c647b11\") " pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:05.222865 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:05.222791    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tkzs"
Jun 02 01:44:05.231641 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:44:05.231606    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9241381e_ccc6_4810_8aac_e1641c647b11.slice/crio-71a1f27d358a86892884fd0bd79baff3aa70225447d052d1160b8b205428c38f WatchSource:0}: Error finding container 71a1f27d358a86892884fd0bd79baff3aa70225447d052d1160b8b205428c38f: Status 404 returned error can't find the container with id 71a1f27d358a86892884fd0bd79baff3aa70225447d052d1160b8b205428c38f
Jun 02 01:44:05.736543 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:05.736487    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tkzs" event={"ID":"9241381e-ccc6-4810-8aac-e1641c647b11","Type":"ContainerStarted","Data":"71a1f27d358a86892884fd0bd79baff3aa70225447d052d1160b8b205428c38f"}
Jun 02 01:44:07.303627 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.303590    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:44:07.304179 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.303742    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:44:07.304972 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.304952    2562 patch_prober.go:28] interesting pod/console-5f94dcf6f7-ktpbw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:44:07.305037 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.304992    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f94dcf6f7-ktpbw" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused"
Jun 02 01:44:07.742802 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.742767    2562 generic.go:358] "Generic (PLEG): container finished" podID="9241381e-ccc6-4810-8aac-e1641c647b11" containerID="ae5892264fb2f13622296c360ac8df427fd2c59458961acc0c918dc34e2acb09" exitCode=0
Jun 02 01:44:07.743027 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:07.742860    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tkzs" event={"ID":"9241381e-ccc6-4810-8aac-e1641c647b11","Type":"ContainerDied","Data":"ae5892264fb2f13622296c360ac8df427fd2c59458961acc0c918dc34e2acb09"}
Jun 02 01:44:08.589662 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.589630    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-785d5d97fd-c5699"]
Jun 02 01:44:08.608096 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.608072    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-785d5d97fd-c5699"]
Jun 02 01:44:08.608223 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.608179    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.610825 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.610803    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 02 01:44:08.611121 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.611103    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 02 01:44:08.611201 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.611137    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vwnzv\""
Jun 02 01:44:08.612801 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.612782    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 02 01:44:08.612926 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.612911    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 02 01:44:08.613045 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.613028    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4o3ea93j6jmor\""
Jun 02 01:44:08.669272 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-metrics-server-audit-profiles\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669385 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-client-certs\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669385 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbt22\" (UniqueName: \"kubernetes.io/projected/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-kube-api-access-lbt22\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-tls\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669587 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-audit-log\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669587 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.669675 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.669592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-client-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.747265 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.747237    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tkzs" event={"ID":"9241381e-ccc6-4810-8aac-e1641c647b11","Type":"ContainerStarted","Data":"b48710c37cac6d82c9fe94763dec5e4da3bc55767f32f9387e97e8a31434f01e"}
Jun 02 01:44:08.747361 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.747271    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tkzs" event={"ID":"9241381e-ccc6-4810-8aac-e1641c647b11","Type":"ContainerStarted","Data":"a28fdbf6a296d704bb789e950334f6365434961ebbeffc8063836a48a3f90c24"}
Jun 02 01:44:08.766319 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.766280    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2tkzs" podStartSLOduration=3.294124514 podStartE2EDuration="4.766269082s" podCreationTimestamp="2026-06-02 01:44:04 +0000 UTC" firstStartedPulling="2026-06-02 01:44:05.23324781 +0000 UTC m=+204.610499316" lastFinishedPulling="2026-06-02 01:44:06.705392376 +0000 UTC m=+206.082643884" observedRunningTime="2026-06-02 01:44:08.765032479 +0000 UTC m=+208.142284009" watchObservedRunningTime="2026-06-02 01:44:08.766269082 +0000 UTC m=+208.143520660"
Jun 02 01:44:08.770260 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770242    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-tls\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770320 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770303    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-audit-log\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770371 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770329    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770622 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770603    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-client-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770719 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770680    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-metrics-server-audit-profiles\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770789 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770770    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-client-certs\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770846 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770804    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbt22\" (UniqueName: \"kubernetes.io/projected/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-kube-api-access-lbt22\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.770846 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.770826    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-audit-log\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.771263 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.771240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.771658 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.771637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-metrics-server-audit-profiles\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.772899 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.772876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-tls\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.772991 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.772948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-client-ca-bundle\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.773285 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.773267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-secret-metrics-server-client-certs\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.778827 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.778807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbt22\" (UniqueName: \"kubernetes.io/projected/fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2-kube-api-access-lbt22\") pod \"metrics-server-785d5d97fd-c5699\" (UID: \"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2\") " pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:08.916978 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:08.916905    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:09.038730 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.038699    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-785d5d97fd-c5699"]
Jun 02 01:44:09.041906 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:44:09.041880    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8c4c69_6b4b_4d7e_a466_cf6a70c8e0f2.slice/crio-f471aa0500177b646607f9a5f129a4260af27d699fab39f203354c7cd019014d WatchSource:0}: Error finding container f471aa0500177b646607f9a5f129a4260af27d699fab39f203354c7cd019014d: Status 404 returned error can't find the container with id f471aa0500177b646607f9a5f129a4260af27d699fab39f203354c7cd019014d
Jun 02 01:44:09.581390 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.581357    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:44:09.609025 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.608995    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:44:09.623416 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.623394    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.629455 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.627210    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:44:09.632398 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.632377    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 02 01:44:09.679009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.678981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679145 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679145 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvgv\" (UniqueName: \"kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679247 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679247 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679247 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.679399 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.679250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.751084 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.751050    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699" event={"ID":"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2","Type":"ContainerStarted","Data":"f471aa0500177b646607f9a5f129a4260af27d699fab39f203354c7cd019014d"}
Jun 02 01:44:09.779921 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.779895    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvgv\" (UniqueName: \"kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780049 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.779964    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780275 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780240    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780409 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780327    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780465 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780414    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780546 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780493    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780606 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780552    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.780731 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.780698    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.781137 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.781096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.781227 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.781181    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.781310 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.781285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.783224 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.783200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.783381 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.783363    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.787923 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.787891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvgv\" (UniqueName: \"kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv\") pod \"console-58469f899-r7wtg\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") " pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:09.936842 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:09.936767    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:10.079662 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.079638    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:44:10.081957 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:44:10.081927    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23df0b39_b1c7_47fe_9283_f88afb71377e.slice/crio-4a69846f1d9bb9cc5ddc44db5c79cfac69fb7b8904291c1a47dec02a8f672f7f WatchSource:0}: Error finding container 4a69846f1d9bb9cc5ddc44db5c79cfac69fb7b8904291c1a47dec02a8f672f7f: Status 404 returned error can't find the container with id 4a69846f1d9bb9cc5ddc44db5c79cfac69fb7b8904291c1a47dec02a8f672f7f
Jun 02 01:44:10.412664 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.412622    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4988d578-sctgr"]
Jun 02 01:44:10.412929 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:44:10.412881    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b4988d578-sctgr" podUID="8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"
Jun 02 01:44:10.498110 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.498055    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:44:10.521904 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.521859    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:44:10.522048 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.522011    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.526555    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.526939    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.527150    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.527352    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.527566    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.529203    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.529432    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 02 01:44:10.529814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.529643    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 02 01:44:10.530307 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.530189    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pzsqp\""
Jun 02 01:44:10.530307 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.530262    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cnocsoctch4rg\""
Jun 02 01:44:10.530307 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.530296    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 02 01:44:10.530800 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.530606    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 02 01:44:10.531052 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.531035    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 02 01:44:10.535086 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.535064    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 02 01:44:10.587612 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.587764 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.587764 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.587764 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.587764 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.587764 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.587986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5cm\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-kube-api-access-fj5cm\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.588212 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.588176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689476 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689388    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689516    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5cm\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-kube-api-access-fj5cm\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689556    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689585    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689804    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689841    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689870    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689899    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.689942 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689929    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689957    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.689989    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690033    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690364 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690063    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690575 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690380    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690575 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690424    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690575 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690476    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690575 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690542    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.690575 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.690569    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.692910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.692811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.692910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.692811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.693169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.693662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.694013    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.694442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695402 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.695050    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.695744 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.695724    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.696095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.696000    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.696754 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.696190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.696852 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.696799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.696916 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.696889    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.697249 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.697195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.698013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.697975    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.698185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.698159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.698417 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.698393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.698808 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.698791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.699202 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.699182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5cm\" (UniqueName: \"kubernetes.io/projected/26ce9d79-08ef-4d09-9933-5ea627dfc6b4-kube-api-access-fj5cm\") pod \"prometheus-k8s-0\" (UID: \"26ce9d79-08ef-4d09-9933-5ea627dfc6b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.756370 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.756338    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58469f899-r7wtg" event={"ID":"23df0b39-b1c7-47fe-9283-f88afb71377e","Type":"ContainerStarted","Data":"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"}
Jun 02 01:44:10.756370 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.756375    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58469f899-r7wtg" event={"ID":"23df0b39-b1c7-47fe-9283-f88afb71377e","Type":"ContainerStarted","Data":"4a69846f1d9bb9cc5ddc44db5c79cfac69fb7b8904291c1a47dec02a8f672f7f"}
Jun 02 01:44:10.756562 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.756401    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:44:10.761847 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.761823    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:44:10.780537 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.780472    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-58469f899-r7wtg" podStartSLOduration=1.780456008 podStartE2EDuration="1.780456008s" podCreationTimestamp="2026-06-02 01:44:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:44:10.778820807 +0000 UTC m=+210.156072341" watchObservedRunningTime="2026-06-02 01:44:10.780456008 +0000 UTC m=+210.157707538"
Jun 02 01:44:10.790980 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.790953    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mkpg\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.790999    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791037    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791060    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791263 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791209    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791263 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791251    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.791363 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791277    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted\") pod \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\" (UID: \"8a5a6b6b-7ad9-482b-b0b7-4eca337c3424\") "
Jun 02 01:44:10.792347 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791692    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:44:10.792347 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.791718    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:44:10.792347 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.792086    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:44:10.793847 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.793817    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:44:10.793941 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.793877    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:44:10.793941 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.793888    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:44:10.794259 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.794241    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg" (OuterVolumeSpecName: "kube-api-access-2mkpg") pod "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" (UID: "8a5a6b6b-7ad9-482b-b0b7-4eca337c3424"). InnerVolumeSpecName "kube-api-access-2mkpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:44:10.836358 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.836329    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893121    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-certificates\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893159    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-trusted-ca\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893175    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-ca-trust-extracted\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893190    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mkpg\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-kube-api-access-2mkpg\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893200    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-image-registry-private-configuration\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893214    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-installation-pull-secrets\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.893411 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.893230    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-bound-sa-token\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:10.990888 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:10.990717    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:44:11.053355 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:44:11.053322    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ce9d79_08ef_4d09_9933_5ea627dfc6b4.slice/crio-221d07a313c512e8216f6e09d0e4db2d6d2a22552bed9292bbd97505ffa813ea WatchSource:0}: Error finding container 221d07a313c512e8216f6e09d0e4db2d6d2a22552bed9292bbd97505ffa813ea: Status 404 returned error can't find the container with id 221d07a313c512e8216f6e09d0e4db2d6d2a22552bed9292bbd97505ffa813ea
Jun 02 01:44:11.760822 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.760780    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699" event={"ID":"fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2","Type":"ContainerStarted","Data":"b1b95cbc5d53a935f3fe6383e2ca7aae83181d033759f8f53752dedf504d68d7"}
Jun 02 01:44:11.761897 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.761872    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"221d07a313c512e8216f6e09d0e4db2d6d2a22552bed9292bbd97505ffa813ea"}
Jun 02 01:44:11.761987 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.761928    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4988d578-sctgr"
Jun 02 01:44:11.777744 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.777704    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699" podStartSLOduration=1.7407224110000001 podStartE2EDuration="3.777692373s" podCreationTimestamp="2026-06-02 01:44:08 +0000 UTC" firstStartedPulling="2026-06-02 01:44:09.043772547 +0000 UTC m=+208.421024058" lastFinishedPulling="2026-06-02 01:44:11.080742513 +0000 UTC m=+210.457994020" observedRunningTime="2026-06-02 01:44:11.776365812 +0000 UTC m=+211.153617345" watchObservedRunningTime="2026-06-02 01:44:11.777692373 +0000 UTC m=+211.154943976"
Jun 02 01:44:11.803418 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.803393    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4988d578-sctgr"]
Jun 02 01:44:11.806281 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.806255    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b4988d578-sctgr"]
Jun 02 01:44:11.901947 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:11.901919    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424-registry-tls\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:12.766046 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:12.766016    2562 generic.go:358] "Generic (PLEG): container finished" podID="26ce9d79-08ef-4d09-9933-5ea627dfc6b4" containerID="eeb004e2a1b12a04f29d2131457a72bc87066d3021137ade051b2f474e7ee7aa" exitCode=0
Jun 02 01:44:12.766452 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:12.766074    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerDied","Data":"eeb004e2a1b12a04f29d2131457a72bc87066d3021137ade051b2f474e7ee7aa"}
Jun 02 01:44:13.156522 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:13.156476    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5a6b6b-7ad9-482b-b0b7-4eca337c3424" path="/var/lib/kubelet/pods/8a5a6b6b-7ad9-482b-b0b7-4eca337c3424/volumes"
Jun 02 01:44:16.780494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:16.780456    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"255c6ca4aba15e1d3b2eda6942fdcc06fbe82b71f76814070e85bd85fd97831d"}
Jun 02 01:44:16.780494 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:16.780491    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"08fb44d21bd34dfae80c87a7caec005ac2d9885c2915cd102ee8ce7e5f943b57"}
Jun 02 01:44:19.791940 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.791909    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"2ecdb714a7a2284dccb2c637b277f0349ccd8a17ebe2cd80f4d8c25491c19928"}
Jun 02 01:44:19.791940 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.791943    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"e75dc575386f3e30600b08f16f3169e322413aaefe2235cacdbca9d86813d4d0"}
Jun 02 01:44:19.792336 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.791953    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"2d68963b2cf660513f0f5a3386f800689b95b7f440ac4d421b341a392b70694f"}
Jun 02 01:44:19.792336 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.791963    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ce9d79-08ef-4d09-9933-5ea627dfc6b4","Type":"ContainerStarted","Data":"b2517646d54afc566b7d448d5c1b801684cb92da05cfbaed8096663282a03c85"}
Jun 02 01:44:19.821957 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.821911    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.067354362 podStartE2EDuration="9.821897902s" podCreationTimestamp="2026-06-02 01:44:10 +0000 UTC" firstStartedPulling="2026-06-02 01:44:11.076817161 +0000 UTC m=+210.454068668" lastFinishedPulling="2026-06-02 01:44:18.831360701 +0000 UTC m=+218.208612208" observedRunningTime="2026-06-02 01:44:19.819266618 +0000 UTC m=+219.196518146" watchObservedRunningTime="2026-06-02 01:44:19.821897902 +0000 UTC m=+219.199149430"
Jun 02 01:44:19.936930 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.936902    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:19.937150 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.936948    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:19.941711 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:19.941690    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:20.800977 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:20.800949    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:44:20.837278 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:20.837245    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:44:28.917421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:28.917388    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:28.917421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:28.917427    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:31.828009 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:31.827975    2562 generic.go:358] "Generic (PLEG): container finished" podID="1b86b8cd-614d-4e37-aa02-70aa09c53e2d" containerID="05f091b58f24a5895742a50d1ac01bb9a5fc45353ecc802d2209398aa8ca73e1" exitCode=0
Jun 02 01:44:31.828343 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:31.828022    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ddxc8" event={"ID":"1b86b8cd-614d-4e37-aa02-70aa09c53e2d","Type":"ContainerDied","Data":"05f091b58f24a5895742a50d1ac01bb9a5fc45353ecc802d2209398aa8ca73e1"}
Jun 02 01:44:31.828403 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:31.828385    2562 scope.go:117] "RemoveContainer" containerID="05f091b58f24a5895742a50d1ac01bb9a5fc45353ecc802d2209398aa8ca73e1"
Jun 02 01:44:32.832197 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:32.832164    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ddxc8" event={"ID":"1b86b8cd-614d-4e37-aa02-70aa09c53e2d","Type":"ContainerStarted","Data":"b54df7dfeae94ccaacf4417e05307349571913d5f9a887a84b8a382b47761a39"}
Jun 02 01:44:34.600241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.600193    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f94dcf6f7-ktpbw" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerName="console" containerID="cri-o://75342ddd3db28b779444c9b7ca645941e22b21ff36ca711c08f5f06d7a2a18f3" gracePeriod=15
Jun 02 01:44:34.838618 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.838584    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f94dcf6f7-ktpbw_eef33155-e21e-4fa8-8123-8456c34ed40b/console/0.log"
Jun 02 01:44:34.838766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.838633    2562 generic.go:358] "Generic (PLEG): container finished" podID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerID="75342ddd3db28b779444c9b7ca645941e22b21ff36ca711c08f5f06d7a2a18f3" exitCode=2
Jun 02 01:44:34.838766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.838671    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f94dcf6f7-ktpbw" event={"ID":"eef33155-e21e-4fa8-8123-8456c34ed40b","Type":"ContainerDied","Data":"75342ddd3db28b779444c9b7ca645941e22b21ff36ca711c08f5f06d7a2a18f3"}
Jun 02 01:44:34.859731 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.859681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f94dcf6f7-ktpbw_eef33155-e21e-4fa8-8123-8456c34ed40b/console/0.log"
Jun 02 01:44:34.859821 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:34.859738    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:44:35.011730 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011692    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.011911 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011739    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.011911 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011806    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhhrl\" (UniqueName: \"kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.011911 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011830    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.012069 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011923    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.012069 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.011947    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config\") pod \"eef33155-e21e-4fa8-8123-8456c34ed40b\" (UID: \"eef33155-e21e-4fa8-8123-8456c34ed40b\") "
Jun 02 01:44:35.012156 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.012116    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:44:35.012298 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.012266    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca" (OuterVolumeSpecName: "service-ca") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:44:35.012298 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.012278    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config" (OuterVolumeSpecName: "console-config") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:44:35.012524 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.012342    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-oauth-serving-cert\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.014198 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.014170    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:44:35.014333 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.014308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl" (OuterVolumeSpecName: "kube-api-access-rhhrl") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "kube-api-access-rhhrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:44:35.014433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.014342    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eef33155-e21e-4fa8-8123-8456c34ed40b" (UID: "eef33155-e21e-4fa8-8123-8456c34ed40b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:44:35.113267 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.113183    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-console-config\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.113267 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.113223    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-oauth-config\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.113267 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.113234    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eef33155-e21e-4fa8-8123-8456c34ed40b-console-serving-cert\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.113267 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.113243    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhhrl\" (UniqueName: \"kubernetes.io/projected/eef33155-e21e-4fa8-8123-8456c34ed40b-kube-api-access-rhhrl\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.113267 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.113253    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eef33155-e21e-4fa8-8123-8456c34ed40b-service-ca\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:44:35.842390 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.842363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f94dcf6f7-ktpbw_eef33155-e21e-4fa8-8123-8456c34ed40b/console/0.log"
Jun 02 01:44:35.842801 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.842448    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f94dcf6f7-ktpbw" event={"ID":"eef33155-e21e-4fa8-8123-8456c34ed40b","Type":"ContainerDied","Data":"6c169e5b781132ca16f51b659070590368dbfcc02772a70596b2f5f7c5444e08"}
Jun 02 01:44:35.842801 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.842479    2562 scope.go:117] "RemoveContainer" containerID="75342ddd3db28b779444c9b7ca645941e22b21ff36ca711c08f5f06d7a2a18f3"
Jun 02 01:44:35.842801 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.842480    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f94dcf6f7-ktpbw"
Jun 02 01:44:35.860153 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.860132    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:44:35.866304 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:35.866284    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f94dcf6f7-ktpbw"]
Jun 02 01:44:37.156644 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:37.156604    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" path="/var/lib/kubelet/pods/eef33155-e21e-4fa8-8123-8456c34ed40b/volumes"
Jun 02 01:44:48.923161 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:48.923125    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:48.927148 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:48.927123    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-785d5d97fd-c5699"
Jun 02 01:44:51.979095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:51.979056    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:44:51.981295 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:51.981275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be8a97ef-f733-469d-b072-d43918a0f0df-metrics-certs\") pod \"network-metrics-daemon-tb55s\" (UID: \"be8a97ef-f733-469d-b072-d43918a0f0df\") " pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:44:52.256974 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:52.256893    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hbws\""
Jun 02 01:44:52.264363 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:52.264345    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb55s"
Jun 02 01:44:52.385489 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:52.385461    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tb55s"]
Jun 02 01:44:52.387755 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:44:52.387727    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8a97ef_f733_469d_b072_d43918a0f0df.slice/crio-69ec47f815b6d665c9f7232d2b4533df4a796fe6e0db926ebad5d6642712f55c WatchSource:0}: Error finding container 69ec47f815b6d665c9f7232d2b4533df4a796fe6e0db926ebad5d6642712f55c: Status 404 returned error can't find the container with id 69ec47f815b6d665c9f7232d2b4533df4a796fe6e0db926ebad5d6642712f55c
Jun 02 01:44:52.889558 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:52.889521    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb55s" event={"ID":"be8a97ef-f733-469d-b072-d43918a0f0df","Type":"ContainerStarted","Data":"69ec47f815b6d665c9f7232d2b4533df4a796fe6e0db926ebad5d6642712f55c"}
Jun 02 01:44:53.893677 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:53.893594    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb55s" event={"ID":"be8a97ef-f733-469d-b072-d43918a0f0df","Type":"ContainerStarted","Data":"574091dc2d03e41b2de0f870f4fac7857a7a03acfed12aff976b68fa2feaf4ab"}
Jun 02 01:44:53.893677 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:53.893634    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb55s" event={"ID":"be8a97ef-f733-469d-b072-d43918a0f0df","Type":"ContainerStarted","Data":"f64e8df73781b1281b9e918036414c6be7fbef9470ee4c3bc21eb51aea09a109"}
Jun 02 01:44:53.911654 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:44:53.911609    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tb55s" podStartSLOduration=251.696661884 podStartE2EDuration="4m12.911595279s" podCreationTimestamp="2026-06-02 01:40:41 +0000 UTC" firstStartedPulling="2026-06-02 01:44:52.389587436 +0000 UTC m=+251.766838946" lastFinishedPulling="2026-06-02 01:44:53.604520832 +0000 UTC m=+252.981772341" observedRunningTime="2026-06-02 01:44:53.909307273 +0000 UTC m=+253.286558802" watchObservedRunningTime="2026-06-02 01:44:53.911595279 +0000 UTC m=+253.288846808"
Jun 02 01:45:10.836754 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:10.836671    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:45:10.856366 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:10.856340    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:45:10.955036 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:10.955013    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:45:20.586248 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:45:20.586191    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ghlkg" podUID="6d57f3a2-84e1-4d01-9654-cc21b15f5293"
Jun 02 01:45:20.586248 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:45:20.586220    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gnwvv" podUID="355f7a90-9071-49a0-82ea-5424317090dc"
Jun 02 01:45:20.961924 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:20.961851    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:20.962056 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:20.961858    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:45:24.560882 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.560848    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:45:24.561265 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.560911    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:24.563371 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.563346    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/355f7a90-9071-49a0-82ea-5424317090dc-metrics-tls\") pod \"dns-default-gnwvv\" (UID: \"355f7a90-9071-49a0-82ea-5424317090dc\") " pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:24.563455 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.563364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d57f3a2-84e1-4d01-9654-cc21b15f5293-cert\") pod \"ingress-canary-ghlkg\" (UID: \"6d57f3a2-84e1-4d01-9654-cc21b15f5293\") " pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:45:24.865406 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.865325    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q2kdm\""
Jun 02 01:45:24.866434 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.866417    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kzbv\""
Jun 02 01:45:24.872800 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.872782    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghlkg"
Jun 02 01:45:24.872888 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:24.872804    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:25.004616 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:25.004573    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghlkg"]
Jun 02 01:45:25.010465 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:45:25.010438    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d57f3a2_84e1_4d01_9654_cc21b15f5293.slice/crio-2afb384e653a85969e0e27aeeb75eb7d998c691fdafac102ba55eef3904d71c0 WatchSource:0}: Error finding container 2afb384e653a85969e0e27aeeb75eb7d998c691fdafac102ba55eef3904d71c0: Status 404 returned error can't find the container with id 2afb384e653a85969e0e27aeeb75eb7d998c691fdafac102ba55eef3904d71c0
Jun 02 01:45:25.025047 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:25.025021    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gnwvv"]
Jun 02 01:45:25.027848 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:45:25.027809    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355f7a90_9071_49a0_82ea_5424317090dc.slice/crio-61ad92aed07c91c833ec211308fca08f2243861d6365dc386f368131ac30e690 WatchSource:0}: Error finding container 61ad92aed07c91c833ec211308fca08f2243861d6365dc386f368131ac30e690: Status 404 returned error can't find the container with id 61ad92aed07c91c833ec211308fca08f2243861d6365dc386f368131ac30e690
Jun 02 01:45:25.977160 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:25.977108    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gnwvv" event={"ID":"355f7a90-9071-49a0-82ea-5424317090dc","Type":"ContainerStarted","Data":"61ad92aed07c91c833ec211308fca08f2243861d6365dc386f368131ac30e690"}
Jun 02 01:45:25.978612 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:25.978585    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghlkg" event={"ID":"6d57f3a2-84e1-4d01-9654-cc21b15f5293","Type":"ContainerStarted","Data":"2afb384e653a85969e0e27aeeb75eb7d998c691fdafac102ba55eef3904d71c0"}
Jun 02 01:45:27.987722 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:27.987683    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghlkg" event={"ID":"6d57f3a2-84e1-4d01-9654-cc21b15f5293","Type":"ContainerStarted","Data":"d7d693b612c952fa381e0189606841f97acfe58c3f83afe9c291632728a9f9b1"}
Jun 02 01:45:27.989135 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:27.989112    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gnwvv" event={"ID":"355f7a90-9071-49a0-82ea-5424317090dc","Type":"ContainerStarted","Data":"64718464829fc64eb89d51ed32802a211b2dbd1bf88a53209bea11176535664a"}
Jun 02 01:45:27.989227 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:27.989141    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gnwvv" event={"ID":"355f7a90-9071-49a0-82ea-5424317090dc","Type":"ContainerStarted","Data":"41ac83f933f54f207ecd30fd7c530c40b6a0398dd0cabf8c513c5c7c6fd9f111"}
Jun 02 01:45:27.989278 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:27.989249    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:28.004167 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:28.004124    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghlkg" podStartSLOduration=251.924954667 podStartE2EDuration="4m14.004112329s" podCreationTimestamp="2026-06-02 01:41:14 +0000 UTC" firstStartedPulling="2026-06-02 01:45:25.012239094 +0000 UTC m=+284.389490600" lastFinishedPulling="2026-06-02 01:45:27.091396751 +0000 UTC m=+286.468648262" observedRunningTime="2026-06-02 01:45:28.003235899 +0000 UTC m=+287.380487427" watchObservedRunningTime="2026-06-02 01:45:28.004112329 +0000 UTC m=+287.381363860"
Jun 02 01:45:28.020951 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:28.020913    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gnwvv" podStartSLOduration=251.964294805 podStartE2EDuration="4m14.020900371s" podCreationTimestamp="2026-06-02 01:41:14 +0000 UTC" firstStartedPulling="2026-06-02 01:45:25.030040215 +0000 UTC m=+284.407291726" lastFinishedPulling="2026-06-02 01:45:27.086645783 +0000 UTC m=+286.463897292" observedRunningTime="2026-06-02 01:45:28.018910696 +0000 UTC m=+287.396162225" watchObservedRunningTime="2026-06-02 01:45:28.020900371 +0000 UTC m=+287.398151929"
Jun 02 01:45:37.994876 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:37.994845    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gnwvv"
Jun 02 01:45:41.113241 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:41.113211    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:45:41.113719 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:41.113682    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:45:41.117437 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:41.117417    2562 kubelet.go:1628] "Image garbage collection succeeded"
Jun 02 01:45:43.187624 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:45:43.187590    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:46:08.207150 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.207091    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-58469f899-r7wtg" podUID="23df0b39-b1c7-47fe-9283-f88afb71377e" containerName="console" containerID="cri-o://1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427" gracePeriod=15
Jun 02 01:46:08.468791 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.468771    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58469f899-r7wtg_23df0b39-b1c7-47fe-9283-f88afb71377e/console/0.log"
Jun 02 01:46:08.468899 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.468829    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:46:08.622948 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.622907    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.622970    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623003    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623037    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623066    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfvgv\" (UniqueName: \"kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623091    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623111    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle\") pod \"23df0b39-b1c7-47fe-9283-f88afb71377e\" (UID: \"23df0b39-b1c7-47fe-9283-f88afb71377e\") "
Jun 02 01:46:08.623436 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623243    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config" (OuterVolumeSpecName: "console-config") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:46:08.623436 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623355    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:46:08.623559 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623462    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-oauth-serving-cert\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.623559 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623483    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-console-config\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.623559 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623480    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca" (OuterVolumeSpecName: "service-ca") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:46:08.623705 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.623635    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:46:08.625226 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.625166    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv" (OuterVolumeSpecName: "kube-api-access-jfvgv") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "kube-api-access-jfvgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:46:08.625226 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.625204    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:46:08.625368 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.625261    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "23df0b39-b1c7-47fe-9283-f88afb71377e" (UID: "23df0b39-b1c7-47fe-9283-f88afb71377e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:46:08.724550 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.724522    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-serving-cert\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.724550 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.724551    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23df0b39-b1c7-47fe-9283-f88afb71377e-console-oauth-config\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.724727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.724561    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfvgv\" (UniqueName: \"kubernetes.io/projected/23df0b39-b1c7-47fe-9283-f88afb71377e-kube-api-access-jfvgv\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.724727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.724570    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-service-ca\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:08.724727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:08.724581    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23df0b39-b1c7-47fe-9283-f88afb71377e-trusted-ca-bundle\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:46:09.107748 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58469f899-r7wtg_23df0b39-b1c7-47fe-9283-f88afb71377e/console/0.log"
Jun 02 01:46:09.107748 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107714    2562 generic.go:358] "Generic (PLEG): container finished" podID="23df0b39-b1c7-47fe-9283-f88afb71377e" containerID="1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427" exitCode=2
Jun 02 01:46:09.107922 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107772    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58469f899-r7wtg" event={"ID":"23df0b39-b1c7-47fe-9283-f88afb71377e","Type":"ContainerDied","Data":"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"}
Jun 02 01:46:09.107922 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107803    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58469f899-r7wtg" event={"ID":"23df0b39-b1c7-47fe-9283-f88afb71377e","Type":"ContainerDied","Data":"4a69846f1d9bb9cc5ddc44db5c79cfac69fb7b8904291c1a47dec02a8f672f7f"}
Jun 02 01:46:09.107922 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107817    2562 scope.go:117] "RemoveContainer" containerID="1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"
Jun 02 01:46:09.107922 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.107778    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58469f899-r7wtg"
Jun 02 01:46:09.116177 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.116157    2562 scope.go:117] "RemoveContainer" containerID="1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"
Jun 02 01:46:09.116470 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:46:09.116453    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427\": container with ID starting with 1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427 not found: ID does not exist" containerID="1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"
Jun 02 01:46:09.116555 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.116479    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427"} err="failed to get container status \"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427\": rpc error: code = NotFound desc = could not find container \"1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427\": container with ID starting with 1e853d7f3ade26c3a57a08b14b05a6ecece580ee37c91965ecd99a18bb8a5427 not found: ID does not exist"
Jun 02 01:46:09.135864 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.135838    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:46:09.140762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.140737    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58469f899-r7wtg"]
Jun 02 01:46:09.156933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:46:09.156906    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23df0b39-b1c7-47fe-9283-f88afb71377e" path="/var/lib/kubelet/pods/23df0b39-b1c7-47fe-9283-f88afb71377e/volumes"
Jun 02 01:47:51.024842 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.024815    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-c4kd9"]
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025224    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerName="console"
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025243    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerName="console"
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025263    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23df0b39-b1c7-47fe-9283-f88afb71377e" containerName="console"
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025271    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="23df0b39-b1c7-47fe-9283-f88afb71377e" containerName="console"
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025333    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="eef33155-e21e-4fa8-8123-8456c34ed40b" containerName="console"
Jun 02 01:47:51.025395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.025349    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="23df0b39-b1c7-47fe-9283-f88afb71377e" containerName="console"
Jun 02 01:47:51.028163 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.028142    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.031060 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.031038    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 02 01:47:51.032434 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.032416    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kvlk4\""
Jun 02 01:47:51.032434 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.032425    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 02 01:47:51.038013 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.037991    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-c4kd9"]
Jun 02 01:47:51.104706 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.104680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-bound-sa-token\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.104843 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.104773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9tv\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-kube-api-access-zl9tv\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.205393 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.205361    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9tv\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-kube-api-access-zl9tv\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.205555 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.205427    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-bound-sa-token\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.214403 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.214374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-bound-sa-token\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.214524 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.214413    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9tv\" (UniqueName: \"kubernetes.io/projected/1a253d6a-f4df-4373-b7e1-bca48ade47bb-kube-api-access-zl9tv\") pod \"cert-manager-79c8d999ff-c4kd9\" (UID: \"1a253d6a-f4df-4373-b7e1-bca48ade47bb\") " pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.353678 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.353586    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-c4kd9"
Jun 02 01:47:51.473780 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.473601    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-c4kd9"]
Jun 02 01:47:51.476467 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:47:51.476431    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a253d6a_f4df_4373_b7e1_bca48ade47bb.slice/crio-7ec08c21ae59fd11db75f951dd1ce447f39ae525e62e130d0882a6242cd53f2f WatchSource:0}: Error finding container 7ec08c21ae59fd11db75f951dd1ce447f39ae525e62e130d0882a6242cd53f2f: Status 404 returned error can't find the container with id 7ec08c21ae59fd11db75f951dd1ce447f39ae525e62e130d0882a6242cd53f2f
Jun 02 01:47:51.478265 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:51.478248    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 01:47:52.382152 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:52.382116    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-c4kd9" event={"ID":"1a253d6a-f4df-4373-b7e1-bca48ade47bb","Type":"ContainerStarted","Data":"7ec08c21ae59fd11db75f951dd1ce447f39ae525e62e130d0882a6242cd53f2f"}
Jun 02 01:47:55.394661 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:55.394621    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-c4kd9" event={"ID":"1a253d6a-f4df-4373-b7e1-bca48ade47bb","Type":"ContainerStarted","Data":"6bce955a8378063f916ee86ae13cde5cfbf35047dc116b1515c62102531ab565"}
Jun 02 01:47:55.412754 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:47:55.412705    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-c4kd9" podStartSLOduration=0.966138794 podStartE2EDuration="4.41269114s" podCreationTimestamp="2026-06-02 01:47:51 +0000 UTC" firstStartedPulling="2026-06-02 01:47:51.47839621 +0000 UTC m=+430.855647716" lastFinishedPulling="2026-06-02 01:47:54.924948552 +0000 UTC m=+434.302200062" observedRunningTime="2026-06-02 01:47:55.41102113 +0000 UTC m=+434.788272659" watchObservedRunningTime="2026-06-02 01:47:55.41269114 +0000 UTC m=+434.789942669"
Jun 02 01:48:14.968967 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.968876    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"]
Jun 02 01:48:14.973102 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.973083    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:14.976623 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.976599    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 02 01:48:14.976623 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.976624    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 02 01:48:14.976776 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.976748    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 02 01:48:14.977070 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.977057    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 02 01:48:14.977709 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.977691    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f8v9d\""
Jun 02 01:48:14.983093 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:14.983071    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"]
Jun 02 01:48:15.103656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.103620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.103820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.103677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.103820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.103726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.103820 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.103815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.103966 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.103851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92sd5\" (UniqueName: \"kubernetes.io/projected/75a2d504-efc1-44bb-8919-f29eb76e9357-kube-api-access-92sd5\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.204890 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.204852    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.204890 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.204893    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.205125 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.204937    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.205125 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.204975    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92sd5\" (UniqueName: \"kubernetes.io/projected/75a2d504-efc1-44bb-8919-f29eb76e9357-kube-api-access-92sd5\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.205125 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.205031    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.205467 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.205432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.207286 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.207268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a2d504-efc1-44bb-8919-f29eb76e9357-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.207533 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.207494    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.207585 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.207496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75a2d504-efc1-44bb-8919-f29eb76e9357-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.212913 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.212891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92sd5\" (UniqueName: \"kubernetes.io/projected/75a2d504-efc1-44bb-8919-f29eb76e9357-kube-api-access-92sd5\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6\" (UID: \"75a2d504-efc1-44bb-8919-f29eb76e9357\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.283531 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.283482    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:15.413472 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.413416    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"]
Jun 02 01:48:15.415876 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:48:15.415845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a2d504_efc1_44bb_8919_f29eb76e9357.slice/crio-64be1a149b9fc9d4cfa12ac0e8ecb2923d53336eaf55da19c413721db3856688 WatchSource:0}: Error finding container 64be1a149b9fc9d4cfa12ac0e8ecb2923d53336eaf55da19c413721db3856688: Status 404 returned error can't find the container with id 64be1a149b9fc9d4cfa12ac0e8ecb2923d53336eaf55da19c413721db3856688
Jun 02 01:48:15.449208 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:15.449177    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6" event={"ID":"75a2d504-efc1-44bb-8919-f29eb76e9357","Type":"ContainerStarted","Data":"64be1a149b9fc9d4cfa12ac0e8ecb2923d53336eaf55da19c413721db3856688"}
Jun 02 01:48:18.464472 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:18.464373    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6" event={"ID":"75a2d504-efc1-44bb-8919-f29eb76e9357","Type":"ContainerStarted","Data":"c2e56c3c1aa08c3ab06d505558a9a2dc3956811fa01e2c72bd9762c29c7dc957"}
Jun 02 01:48:19.468974 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:19.468883    2562 generic.go:358] "Generic (PLEG): container finished" podID="75a2d504-efc1-44bb-8919-f29eb76e9357" containerID="c2e56c3c1aa08c3ab06d505558a9a2dc3956811fa01e2c72bd9762c29c7dc957" exitCode=0
Jun 02 01:48:19.469302 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:19.468971    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6" event={"ID":"75a2d504-efc1-44bb-8919-f29eb76e9357","Type":"ContainerDied","Data":"c2e56c3c1aa08c3ab06d505558a9a2dc3956811fa01e2c72bd9762c29c7dc957"}
Jun 02 01:48:20.473254 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:20.473216    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6" event={"ID":"75a2d504-efc1-44bb-8919-f29eb76e9357","Type":"ContainerStarted","Data":"fd21cd82995698c06fb7dc79833321ddb9f9f6abb8647cc211ce4df7dadd23ad"}
Jun 02 01:48:20.473663 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:20.473337    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:20.497210 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:20.497165    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6" podStartSLOduration=2.144153144 podStartE2EDuration="6.497152598s" podCreationTimestamp="2026-06-02 01:48:14 +0000 UTC" firstStartedPulling="2026-06-02 01:48:15.417594043 +0000 UTC m=+454.794845553" lastFinishedPulling="2026-06-02 01:48:19.770593485 +0000 UTC m=+459.147845007" observedRunningTime="2026-06-02 01:48:20.494846404 +0000 UTC m=+459.872097932" watchObservedRunningTime="2026-06-02 01:48:20.497152598 +0000 UTC m=+459.874404127"
Jun 02 01:48:31.479550 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:31.479492    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6"
Jun 02 01:48:42.901394 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.901358    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"]
Jun 02 01:48:42.906012 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.905995    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:42.910527 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910490    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:48:42.910527 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910490    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 02 01:48:42.910727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910546    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 02 01:48:42.910727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910574    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fqqtz\""
Jun 02 01:48:42.910727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910595    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 02 01:48:42.910727 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.910612    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 02 01:48:42.915141 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.915119    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"]
Jun 02 01:48:42.928737 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.928706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39a4e288-bf5c-454b-9f5c-6adbd389ff10-manager-config\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:42.928737 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.928737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskrm\" (UniqueName: \"kubernetes.io/projected/39a4e288-bf5c-454b-9f5c-6adbd389ff10-kube-api-access-jskrm\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:42.928907 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.928813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-metrics-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:42.928907 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:42.928852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.029309 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.029283    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-metrics-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.029433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.029319    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.029433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.029343    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39a4e288-bf5c-454b-9f5c-6adbd389ff10-manager-config\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.029433 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.029364    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jskrm\" (UniqueName: \"kubernetes.io/projected/39a4e288-bf5c-454b-9f5c-6adbd389ff10-kube-api-access-jskrm\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.030038 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.030020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39a4e288-bf5c-454b-9f5c-6adbd389ff10-manager-config\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.031684 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.031665    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-metrics-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.031782 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.031687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a4e288-bf5c-454b-9f5c-6adbd389ff10-cert\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.042059 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.042029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskrm\" (UniqueName: \"kubernetes.io/projected/39a4e288-bf5c-454b-9f5c-6adbd389ff10-kube-api-access-jskrm\") pod \"lws-controller-manager-74db8bbd6d-2rjwr\" (UID: \"39a4e288-bf5c-454b-9f5c-6adbd389ff10\") " pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.215769 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.215703    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:43.337945 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.337841    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"]
Jun 02 01:48:43.340546 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:48:43.340519    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a4e288_bf5c_454b_9f5c_6adbd389ff10.slice/crio-1892de5f597ffa78e5048efd674f892ebda756c3990fa6a57bf8c640ceda5e64 WatchSource:0}: Error finding container 1892de5f597ffa78e5048efd674f892ebda756c3990fa6a57bf8c640ceda5e64: Status 404 returned error can't find the container with id 1892de5f597ffa78e5048efd674f892ebda756c3990fa6a57bf8c640ceda5e64
Jun 02 01:48:43.540432 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:43.540393    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr" event={"ID":"39a4e288-bf5c-454b-9f5c-6adbd389ff10","Type":"ContainerStarted","Data":"1892de5f597ffa78e5048efd674f892ebda756c3990fa6a57bf8c640ceda5e64"}
Jun 02 01:48:46.552041 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:46.551958    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr" event={"ID":"39a4e288-bf5c-454b-9f5c-6adbd389ff10","Type":"ContainerStarted","Data":"6f0fa5097f723a9148e1936f224a59e7c83bde5bb979691d272c79b70fd31b08"}
Jun 02 01:48:46.552382 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:46.552064    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:48:46.570674 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:46.570629    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr" podStartSLOduration=1.671174702 podStartE2EDuration="4.570615335s" podCreationTimestamp="2026-06-02 01:48:42 +0000 UTC" firstStartedPulling="2026-06-02 01:48:43.342298901 +0000 UTC m=+482.719550411" lastFinishedPulling="2026-06-02 01:48:46.241739525 +0000 UTC m=+485.618991044" observedRunningTime="2026-06-02 01:48:46.569468789 +0000 UTC m=+485.946720318" watchObservedRunningTime="2026-06-02 01:48:46.570615335 +0000 UTC m=+485.947866864"
Jun 02 01:48:57.556541 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:48:57.556496    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74db8bbd6d-2rjwr"
Jun 02 01:49:04.014160 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.014127    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-gk4wp"]
Jun 02 01:49:04.017309 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.017287    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.020430 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.020405    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fhxrw\""
Jun 02 01:49:04.020559 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.020414    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 02 01:49:04.024887 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.024867    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-gk4wp"]
Jun 02 01:49:04.102482 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.102443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvhz\" (UniqueName: \"kubernetes.io/projected/441cc249-25e2-4139-b7a7-07694d6b7415-kube-api-access-bmvhz\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.102687 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.102568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/441cc249-25e2-4139-b7a7-07694d6b7415-redirect-config\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.203039 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.203004    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/441cc249-25e2-4139-b7a7-07694d6b7415-redirect-config\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.203205 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.203057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvhz\" (UniqueName: \"kubernetes.io/projected/441cc249-25e2-4139-b7a7-07694d6b7415-kube-api-access-bmvhz\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.203803 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.203781    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/441cc249-25e2-4139-b7a7-07694d6b7415-redirect-config\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.212193 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.212164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvhz\" (UniqueName: \"kubernetes.io/projected/441cc249-25e2-4139-b7a7-07694d6b7415-kube-api-access-bmvhz\") pod \"dashboard-redirect-5f9c748996-gk4wp\" (UID: \"441cc249-25e2-4139-b7a7-07694d6b7415\") " pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.327899 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.327806    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp"
Jun 02 01:49:04.453440 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.453371    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-gk4wp"]
Jun 02 01:49:04.456024 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:49:04.455999    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441cc249_25e2_4139_b7a7_07694d6b7415.slice/crio-e35e770c62e48b80e21f7a9c7f3e3b8d4dcdd7157ea0b83a185b13d09dffbc74 WatchSource:0}: Error finding container e35e770c62e48b80e21f7a9c7f3e3b8d4dcdd7157ea0b83a185b13d09dffbc74: Status 404 returned error can't find the container with id e35e770c62e48b80e21f7a9c7f3e3b8d4dcdd7157ea0b83a185b13d09dffbc74
Jun 02 01:49:04.609429 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:04.609338    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp" event={"ID":"441cc249-25e2-4139-b7a7-07694d6b7415","Type":"ContainerStarted","Data":"e35e770c62e48b80e21f7a9c7f3e3b8d4dcdd7157ea0b83a185b13d09dffbc74"}
Jun 02 01:49:07.619335 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:07.619297    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp" event={"ID":"441cc249-25e2-4139-b7a7-07694d6b7415","Type":"ContainerStarted","Data":"4657feb2609c783646f372ca1d47abcd6804cf17477d89f93f2bcb1a413e8d6f"}
Jun 02 01:49:07.642408 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:07.642363    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f9c748996-gk4wp" podStartSLOduration=2.194784261 podStartE2EDuration="4.642349836s" podCreationTimestamp="2026-06-02 01:49:03 +0000 UTC" firstStartedPulling="2026-06-02 01:49:04.45733927 +0000 UTC m=+503.834590777" lastFinishedPulling="2026-06-02 01:49:06.904904846 +0000 UTC m=+506.282156352" observedRunningTime="2026-06-02 01:49:07.641397468 +0000 UTC m=+507.018649002" watchObservedRunningTime="2026-06-02 01:49:07.642349836 +0000 UTC m=+507.019601365"
Jun 02 01:49:30.869420 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.869347    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"]
Jun 02 01:49:30.872887 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.872865    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:30.875847 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.875826    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 02 01:49:30.876073 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.876052    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jckrx\""
Jun 02 01:49:30.876142 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.876093    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 02 01:49:30.876346 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.876332    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 02 01:49:30.884172 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:30.884150    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"]
Jun 02 01:49:31.027661 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027661 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnwq\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-kube-api-access-gdnwq\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027929 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027929 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.027992 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.028024 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.027992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2bca46-5c78-4139-83b8-f6f158a996e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.128856 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128781    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.128856 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128825    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.128856 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128846    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128874    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2bca46-5c78-4139-83b8-f6f158a996e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128901    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128916    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128940    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128963    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129064 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.128984    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnwq\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-kube-api-access-gdnwq\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129355 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.129332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129442 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.129423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129489 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.129434    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129489 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.129443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.129719 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.129703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2bca46-5c78-4139-83b8-f6f158a996e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.131120 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.131098    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.131538 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.131517    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.139384 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.139356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnwq\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-kube-api-access-gdnwq\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.139734 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.139714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2bca46-5c78-4139-83b8-f6f158a996e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8rlwqn\" (UID: \"dd2bca46-5c78-4139-83b8-f6f158a996e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.187358 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.187337    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:31.317458 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.317431    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"]
Jun 02 01:49:31.319739 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:49:31.319714    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2bca46_5c78_4139_83b8_f6f158a996e2.slice/crio-234fa8e4291322652d1613f020c2ee9f8a6ab68bac7044d31c505d83de32a01d WatchSource:0}: Error finding container 234fa8e4291322652d1613f020c2ee9f8a6ab68bac7044d31c505d83de32a01d: Status 404 returned error can't find the container with id 234fa8e4291322652d1613f020c2ee9f8a6ab68bac7044d31c505d83de32a01d
Jun 02 01:49:31.695097 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:31.695058    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn" event={"ID":"dd2bca46-5c78-4139-83b8-f6f158a996e2","Type":"ContainerStarted","Data":"234fa8e4291322652d1613f020c2ee9f8a6ab68bac7044d31c505d83de32a01d"}
Jun 02 01:49:33.847391 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:33.847345    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:49:33.847701 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:33.847435    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:49:33.847701 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:33.847469    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:49:34.707601 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.707564    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn" event={"ID":"dd2bca46-5c78-4139-83b8-f6f158a996e2","Type":"ContainerStarted","Data":"03e68612c7a54faf5abc8e15cf6bd15222c3cdf8225cdbfc90d47f1484298f28"}
Jun 02 01:49:34.733225 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.733173    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn" podStartSLOduration=2.207712746 podStartE2EDuration="4.733158723s" podCreationTimestamp="2026-06-02 01:49:30 +0000 UTC" firstStartedPulling="2026-06-02 01:49:31.321621687 +0000 UTC m=+530.698873195" lastFinishedPulling="2026-06-02 01:49:33.847067665 +0000 UTC m=+533.224319172" observedRunningTime="2026-06-02 01:49:34.731582514 +0000 UTC m=+534.108834044" watchObservedRunningTime="2026-06-02 01:49:34.733158723 +0000 UTC m=+534.110410253"
Jun 02 01:49:34.865543 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.865495    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:34.868702 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.868683    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:34.871586 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.871565    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 02 01:49:34.871699 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.871592    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jvrhn\""
Jun 02 01:49:34.871699 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.871608    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 02 01:49:34.878590 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.878568    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:34.962202 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:34.962124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz4f\" (UniqueName: \"kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f\") pod \"kuadrant-operator-catalog-z2jt9\" (UID: \"09477489-d72b-491f-8746-5e9f575d039b\") " pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:35.062703 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.062665    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz4f\" (UniqueName: \"kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f\") pod \"kuadrant-operator-catalog-z2jt9\" (UID: \"09477489-d72b-491f-8746-5e9f575d039b\") " pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:35.071039 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.071009    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz4f\" (UniqueName: \"kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f\") pod \"kuadrant-operator-catalog-z2jt9\" (UID: \"09477489-d72b-491f-8746-5e9f575d039b\") " pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:35.178618 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.178590    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:35.188269 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.188238    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:35.189814 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.189778    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Jun 02 01:49:35.189914 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.189825    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn" podUID="dd2bca46-5c78-4139-83b8-f6f158a996e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Jun 02 01:49:35.240203 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.240156    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:35.302233 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.302212    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:35.304528 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:49:35.304486    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09477489_d72b_491f_8746_5e9f575d039b.slice/crio-9a94c948d238825e74100df429aee79388fcdff855b531e24ea7af8ad721210e WatchSource:0}: Error finding container 9a94c948d238825e74100df429aee79388fcdff855b531e24ea7af8ad721210e: Status 404 returned error can't find the container with id 9a94c948d238825e74100df429aee79388fcdff855b531e24ea7af8ad721210e
Jun 02 01:49:35.444204 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.444172    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nlclh"]
Jun 02 01:49:35.448784 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.448766    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:35.454207 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.454182    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nlclh"]
Jun 02 01:49:35.566824 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.566791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxvj\" (UniqueName: \"kubernetes.io/projected/59f98e65-d550-4fdd-b588-0979f7c77b76-kube-api-access-jlxvj\") pod \"kuadrant-operator-catalog-nlclh\" (UID: \"59f98e65-d550-4fdd-b588-0979f7c77b76\") " pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:35.667268 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.667235    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxvj\" (UniqueName: \"kubernetes.io/projected/59f98e65-d550-4fdd-b588-0979f7c77b76-kube-api-access-jlxvj\") pod \"kuadrant-operator-catalog-nlclh\" (UID: \"59f98e65-d550-4fdd-b588-0979f7c77b76\") " pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:35.679415 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.679394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxvj\" (UniqueName: \"kubernetes.io/projected/59f98e65-d550-4fdd-b588-0979f7c77b76-kube-api-access-jlxvj\") pod \"kuadrant-operator-catalog-nlclh\" (UID: \"59f98e65-d550-4fdd-b588-0979f7c77b76\") " pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:35.711779 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.711751    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" event={"ID":"09477489-d72b-491f-8746-5e9f575d039b","Type":"ContainerStarted","Data":"9a94c948d238825e74100df429aee79388fcdff855b531e24ea7af8ad721210e"}
Jun 02 01:49:35.759337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.759311    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:35.897040 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:35.897016    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nlclh"]
Jun 02 01:49:35.899346 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:49:35.899311    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f98e65_d550_4fdd_b588_0979f7c77b76.slice/crio-bd9ac1cc1fb7ab66dd479456df4fef9c5da655ad51190698c53c2ee9da3047c6 WatchSource:0}: Error finding container bd9ac1cc1fb7ab66dd479456df4fef9c5da655ad51190698c53c2ee9da3047c6: Status 404 returned error can't find the container with id bd9ac1cc1fb7ab66dd479456df4fef9c5da655ad51190698c53c2ee9da3047c6
Jun 02 01:49:36.192350 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:36.192272    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:36.716786 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:36.716749    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nlclh" event={"ID":"59f98e65-d550-4fdd-b588-0979f7c77b76","Type":"ContainerStarted","Data":"bd9ac1cc1fb7ab66dd479456df4fef9c5da655ad51190698c53c2ee9da3047c6"}
Jun 02 01:49:36.717079 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:36.717057    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:36.718207 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:36.718184    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8rlwqn"
Jun 02 01:49:37.722369 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.722265    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" event={"ID":"09477489-d72b-491f-8746-5e9f575d039b","Type":"ContainerStarted","Data":"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"}
Jun 02 01:49:37.722369 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.722310    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" podUID="09477489-d72b-491f-8746-5e9f575d039b" containerName="registry-server" containerID="cri-o://4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef" gracePeriod=2
Jun 02 01:49:37.723792 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.723766    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nlclh" event={"ID":"59f98e65-d550-4fdd-b588-0979f7c77b76","Type":"ContainerStarted","Data":"1626e242586a484be3af326bd496c7b4cdb4b64ccefc42d8a969303ab8c147c2"}
Jun 02 01:49:37.737695 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.737646    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" podStartSLOduration=1.574919613 podStartE2EDuration="3.737632191s" podCreationTimestamp="2026-06-02 01:49:34 +0000 UTC" firstStartedPulling="2026-06-02 01:49:35.305883721 +0000 UTC m=+534.683135231" lastFinishedPulling="2026-06-02 01:49:37.468596289 +0000 UTC m=+536.845847809" observedRunningTime="2026-06-02 01:49:37.736658269 +0000 UTC m=+537.113909799" watchObservedRunningTime="2026-06-02 01:49:37.737632191 +0000 UTC m=+537.114883793"
Jun 02 01:49:37.752276 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.752218    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nlclh" podStartSLOduration=1.183495892 podStartE2EDuration="2.752204954s" podCreationTimestamp="2026-06-02 01:49:35 +0000 UTC" firstStartedPulling="2026-06-02 01:49:35.900641555 +0000 UTC m=+535.277893063" lastFinishedPulling="2026-06-02 01:49:37.469350604 +0000 UTC m=+536.846602125" observedRunningTime="2026-06-02 01:49:37.750842174 +0000 UTC m=+537.128093722" watchObservedRunningTime="2026-06-02 01:49:37.752204954 +0000 UTC m=+537.129456483"
Jun 02 01:49:37.966558 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.966534    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:37.992757 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.992714    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmz4f\" (UniqueName: \"kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f\") pod \"09477489-d72b-491f-8746-5e9f575d039b\" (UID: \"09477489-d72b-491f-8746-5e9f575d039b\") "
Jun 02 01:49:37.994933 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:37.994902    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f" (OuterVolumeSpecName: "kube-api-access-hmz4f") pod "09477489-d72b-491f-8746-5e9f575d039b" (UID: "09477489-d72b-491f-8746-5e9f575d039b"). InnerVolumeSpecName "kube-api-access-hmz4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:49:38.093746 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.093708    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmz4f\" (UniqueName: \"kubernetes.io/projected/09477489-d72b-491f-8746-5e9f575d039b-kube-api-access-hmz4f\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:49:38.728079 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.728042    2562 generic.go:358] "Generic (PLEG): container finished" podID="09477489-d72b-491f-8746-5e9f575d039b" containerID="4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef" exitCode=0
Jun 02 01:49:38.728520 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.728102    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9"
Jun 02 01:49:38.728520 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.728131    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" event={"ID":"09477489-d72b-491f-8746-5e9f575d039b","Type":"ContainerDied","Data":"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"}
Jun 02 01:49:38.728520 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.728166    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2jt9" event={"ID":"09477489-d72b-491f-8746-5e9f575d039b","Type":"ContainerDied","Data":"9a94c948d238825e74100df429aee79388fcdff855b531e24ea7af8ad721210e"}
Jun 02 01:49:38.728520 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.728186    2562 scope.go:117] "RemoveContainer" containerID="4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"
Jun 02 01:49:38.736953 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.736936    2562 scope.go:117] "RemoveContainer" containerID="4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"
Jun 02 01:49:38.737174 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:49:38.737156    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef\": container with ID starting with 4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef not found: ID does not exist" containerID="4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"
Jun 02 01:49:38.737216 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.737182    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef"} err="failed to get container status \"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef\": rpc error: code = NotFound desc = could not find container \"4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef\": container with ID starting with 4d509fc72505bb8f10c3110cb039a4fdd649333044ec9ccddf4e7134c84814ef not found: ID does not exist"
Jun 02 01:49:38.749491 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.749437    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:38.751354 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:38.751336    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2jt9"]
Jun 02 01:49:39.157939 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:39.157857    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09477489-d72b-491f-8746-5e9f575d039b" path="/var/lib/kubelet/pods/09477489-d72b-491f-8746-5e9f575d039b/volumes"
Jun 02 01:49:45.759855 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:45.759826    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:45.759855 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:45.759864    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:45.781447 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:45.781423    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:49:46.775571 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:49:46.775541    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nlclh"
Jun 02 01:50:08.586161 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.586118    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"]
Jun 02 01:50:08.586699 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.586637    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09477489-d72b-491f-8746-5e9f575d039b" containerName="registry-server"
Jun 02 01:50:08.586699 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.586654    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="09477489-d72b-491f-8746-5e9f575d039b" containerName="registry-server"
Jun 02 01:50:08.586798 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.586743    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="09477489-d72b-491f-8746-5e9f575d039b" containerName="registry-server"
Jun 02 01:50:08.593581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.593561    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.597948 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.597921    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z458q\""
Jun 02 01:50:08.603236 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.603209    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"]
Jun 02 01:50:08.646756 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.646713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.646930 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.646795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxn2\" (UniqueName: \"kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.747668 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.747614    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxn2\" (UniqueName: \"kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.747844 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.747730    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.748122 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.748104    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.762383 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.762358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxn2\" (UniqueName: \"kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:08.907062 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:08.906978    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:09.047892 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:09.047765    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"]
Jun 02 01:50:09.050332 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:50:09.050300    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e255ce7_a381_4959_9816_525489ce4fab.slice/crio-2ddad942ed0be10650643e614d9a7a47d48a4b5983917abd7086ae54cc60f356 WatchSource:0}: Error finding container 2ddad942ed0be10650643e614d9a7a47d48a4b5983917abd7086ae54cc60f356: Status 404 returned error can't find the container with id 2ddad942ed0be10650643e614d9a7a47d48a4b5983917abd7086ae54cc60f356
Jun 02 01:50:09.831055 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:09.831011    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" event={"ID":"0e255ce7-a381-4959-9816-525489ce4fab","Type":"ContainerStarted","Data":"2ddad942ed0be10650643e614d9a7a47d48a4b5983917abd7086ae54cc60f356"}
Jun 02 01:50:11.418222 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.418186    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dhmnp"]
Jun 02 01:50:11.425664 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.425646    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:11.429455 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.429434    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xfmf5\""
Jun 02 01:50:11.436548 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.436525    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dhmnp"]
Jun 02 01:50:11.574997 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.574967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4x4\" (UniqueName: \"kubernetes.io/projected/e4582c7d-acb5-4286-856b-5b4d3ebdfe62-kube-api-access-dj4x4\") pod \"authorino-operator-657f44b778-dhmnp\" (UID: \"e4582c7d-acb5-4286-856b-5b4d3ebdfe62\") " pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:11.676368 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.676301    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4x4\" (UniqueName: \"kubernetes.io/projected/e4582c7d-acb5-4286-856b-5b4d3ebdfe62-kube-api-access-dj4x4\") pod \"authorino-operator-657f44b778-dhmnp\" (UID: \"e4582c7d-acb5-4286-856b-5b4d3ebdfe62\") " pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:11.692985 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.692958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4x4\" (UniqueName: \"kubernetes.io/projected/e4582c7d-acb5-4286-856b-5b4d3ebdfe62-kube-api-access-dj4x4\") pod \"authorino-operator-657f44b778-dhmnp\" (UID: \"e4582c7d-acb5-4286-856b-5b4d3ebdfe62\") " pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:11.735619 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.735593    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:11.886344 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:11.886166    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dhmnp"]
Jun 02 01:50:11.889307 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:50:11.889276    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4582c7d_acb5_4286_856b_5b4d3ebdfe62.slice/crio-9ac11b8e3fccbcd711f3e28b20365eedc5998bd07640f482ae89f0b5c0d1c84a WatchSource:0}: Error finding container 9ac11b8e3fccbcd711f3e28b20365eedc5998bd07640f482ae89f0b5c0d1c84a: Status 404 returned error can't find the container with id 9ac11b8e3fccbcd711f3e28b20365eedc5998bd07640f482ae89f0b5c0d1c84a
Jun 02 01:50:12.843638 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:12.843567    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp" event={"ID":"e4582c7d-acb5-4286-856b-5b4d3ebdfe62","Type":"ContainerStarted","Data":"9ac11b8e3fccbcd711f3e28b20365eedc5998bd07640f482ae89f0b5c0d1c84a"}
Jun 02 01:50:15.856078 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.856041    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp" event={"ID":"e4582c7d-acb5-4286-856b-5b4d3ebdfe62","Type":"ContainerStarted","Data":"f7bb9278f659a276b26b0e5e16956273f3bd35f05f1ab6c55d614d79637b31df"}
Jun 02 01:50:15.856487 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.856229    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:15.857387 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.857365    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" event={"ID":"0e255ce7-a381-4959-9816-525489ce4fab","Type":"ContainerStarted","Data":"70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe"}
Jun 02 01:50:15.857484 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.857473    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:15.876665 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.876623    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp" podStartSLOduration=1.77736785 podStartE2EDuration="4.8766111s" podCreationTimestamp="2026-06-02 01:50:11 +0000 UTC" firstStartedPulling="2026-06-02 01:50:11.891701263 +0000 UTC m=+571.268952773" lastFinishedPulling="2026-06-02 01:50:14.990944516 +0000 UTC m=+574.368196023" observedRunningTime="2026-06-02 01:50:15.874897928 +0000 UTC m=+575.252149469" watchObservedRunningTime="2026-06-02 01:50:15.8766111 +0000 UTC m=+575.253862629"
Jun 02 01:50:15.892737 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:15.892691    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" podStartSLOduration=1.988233729 podStartE2EDuration="7.892679044s" podCreationTimestamp="2026-06-02 01:50:08 +0000 UTC" firstStartedPulling="2026-06-02 01:50:09.052633649 +0000 UTC m=+568.429885169" lastFinishedPulling="2026-06-02 01:50:14.957078967 +0000 UTC m=+574.334330484" observedRunningTime="2026-06-02 01:50:15.891858253 +0000 UTC m=+575.269109782" watchObservedRunningTime="2026-06-02 01:50:15.892679044 +0000 UTC m=+575.269930572"
Jun 02 01:50:26.862869 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:26.862837    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:26.863259 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:26.862894    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-dhmnp"
Jun 02 01:50:28.655453 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.655421    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"]
Jun 02 01:50:28.655890 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.655655    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" podUID="0e255ce7-a381-4959-9816-525489ce4fab" containerName="manager" containerID="cri-o://70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe" gracePeriod=2
Jun 02 01:50:28.658467 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.658428    2562 status_manager.go:895] "Failed to get status for pod" podUID="0e255ce7-a381-4959-9816-525489ce4fab" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" is forbidden: User \"system:node:ip-10-0-129-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-109.ec2.internal' and this object"
Jun 02 01:50:28.660172 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.660144    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"]
Jun 02 01:50:28.677716 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.677694    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:28.678057 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.678043    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e255ce7-a381-4959-9816-525489ce4fab" containerName="manager"
Jun 02 01:50:28.678057 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.678057    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e255ce7-a381-4959-9816-525489ce4fab" containerName="manager"
Jun 02 01:50:28.678189 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.678110    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e255ce7-a381-4959-9816-525489ce4fab" containerName="manager"
Jun 02 01:50:28.680986 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.680965    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.683480 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.683450    2562 status_manager.go:895] "Failed to get status for pod" podUID="0e255ce7-a381-4959-9816-525489ce4fab" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" is forbidden: User \"system:node:ip-10-0-129-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-109.ec2.internal' and this object"
Jun 02 01:50:28.694538 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.694496    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:28.831189 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.831158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhwq\" (UniqueName: \"kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.831337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.831223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.881591 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.881569    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:28.884345 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.884317    2562 status_manager.go:895] "Failed to get status for pod" podUID="0e255ce7-a381-4959-9816-525489ce4fab" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" is forbidden: User \"system:node:ip-10-0-129-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-109.ec2.internal' and this object"
Jun 02 01:50:28.901076 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.901042    2562 generic.go:358] "Generic (PLEG): container finished" podID="0e255ce7-a381-4959-9816-525489ce4fab" containerID="70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe" exitCode=0
Jun 02 01:50:28.901203 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.901089    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk"
Jun 02 01:50:28.901203 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.901150    2562 scope.go:117] "RemoveContainer" containerID="70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe"
Jun 02 01:50:28.904215 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.904192    2562 status_manager.go:895] "Failed to get status for pod" podUID="0e255ce7-a381-4959-9816-525489ce4fab" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-c7cwk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-c7cwk\" is forbidden: User \"system:node:ip-10-0-129-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-109.ec2.internal' and this object"
Jun 02 01:50:28.908985 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.908971    2562 scope.go:117] "RemoveContainer" containerID="70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe"
Jun 02 01:50:28.909212 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:50:28.909190    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe\": container with ID starting with 70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe not found: ID does not exist" containerID="70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe"
Jun 02 01:50:28.909268 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.909218    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe"} err="failed to get container status \"70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe\": rpc error: code = NotFound desc = could not find container \"70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe\": container with ID starting with 70ecc105fa6b70724d0cc17054441ea4cca701314d1ad4ce9796639bb6d3dffe not found: ID does not exist"
Jun 02 01:50:28.932339 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.932315    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhwq\" (UniqueName: \"kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.932421 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.932358    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.932690 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.932675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:28.947077 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:28.947046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhwq\" (UniqueName: \"kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tzfz4\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:29.031648 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.031610    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:29.033434 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.033414    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzxn2\" (UniqueName: \"kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2\") pod \"0e255ce7-a381-4959-9816-525489ce4fab\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") "
Jun 02 01:50:29.033563 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.033452    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume\") pod \"0e255ce7-a381-4959-9816-525489ce4fab\" (UID: \"0e255ce7-a381-4959-9816-525489ce4fab\") "
Jun 02 01:50:29.034058 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.034031    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0e255ce7-a381-4959-9816-525489ce4fab" (UID: "0e255ce7-a381-4959-9816-525489ce4fab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:50:29.035375 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.035344    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2" (OuterVolumeSpecName: "kube-api-access-xzxn2") pod "0e255ce7-a381-4959-9816-525489ce4fab" (UID: "0e255ce7-a381-4959-9816-525489ce4fab"). InnerVolumeSpecName "kube-api-access-xzxn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:50:29.134569 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.134539    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzxn2\" (UniqueName: \"kubernetes.io/projected/0e255ce7-a381-4959-9816-525489ce4fab-kube-api-access-xzxn2\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:50:29.134569 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.134565    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e255ce7-a381-4959-9816-525489ce4fab-extensions-socket-volume\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:50:29.158044 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.158015    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e255ce7-a381-4959-9816-525489ce4fab" path="/var/lib/kubelet/pods/0e255ce7-a381-4959-9816-525489ce4fab/volumes"
Jun 02 01:50:29.167222 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.167115    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:29.169845 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:50:29.169819    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8368a052_8817_4227_ae51_9f89306e87c3.slice/crio-3e9f78701546c5fb6733f5f782d93c1518c707d6c271b7889b8b62cfcec58495 WatchSource:0}: Error finding container 3e9f78701546c5fb6733f5f782d93c1518c707d6c271b7889b8b62cfcec58495: Status 404 returned error can't find the container with id 3e9f78701546c5fb6733f5f782d93c1518c707d6c271b7889b8b62cfcec58495
Jun 02 01:50:29.564182 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.564146    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"]
Jun 02 01:50:29.567883 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.567865    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.583599 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.583574    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"]
Jun 02 01:50:29.740004 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.739968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.740004 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.740005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6s8\" (UniqueName: \"kubernetes.io/projected/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-kube-api-access-gj6s8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.841317 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.841232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.841317 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.841267    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6s8\" (UniqueName: \"kubernetes.io/projected/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-kube-api-access-gj6s8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.841617 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.841596    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.852032 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.852007    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6s8\" (UniqueName: \"kubernetes.io/projected/d0d28bbe-1bc6-4d5e-a110-4f10837361b1-kube-api-access-gj6s8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rjrvv\" (UID: \"d0d28bbe-1bc6-4d5e-a110-4f10837361b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.878332 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.878308    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:29.906761 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.906726    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" event={"ID":"8368a052-8817-4227-ae51-9f89306e87c3","Type":"ContainerStarted","Data":"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"}
Jun 02 01:50:29.906910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.906768    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" event={"ID":"8368a052-8817-4227-ae51-9f89306e87c3","Type":"ContainerStarted","Data":"3e9f78701546c5fb6733f5f782d93c1518c707d6c271b7889b8b62cfcec58495"}
Jun 02 01:50:29.906910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.906787    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:29.936782 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:29.936737    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" podStartSLOduration=1.936722711 podStartE2EDuration="1.936722711s" podCreationTimestamp="2026-06-02 01:50:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:29.936289457 +0000 UTC m=+589.313540991" watchObservedRunningTime="2026-06-02 01:50:29.936722711 +0000 UTC m=+589.313974239"
Jun 02 01:50:30.023647 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:30.023618    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"]
Jun 02 01:50:30.025467 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:50:30.025442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d28bbe_1bc6_4d5e_a110_4f10837361b1.slice/crio-038f1d0a75a2b1535297cc04be4ad69163efd89e1650f10ecce175112afd920b WatchSource:0}: Error finding container 038f1d0a75a2b1535297cc04be4ad69163efd89e1650f10ecce175112afd920b: Status 404 returned error can't find the container with id 038f1d0a75a2b1535297cc04be4ad69163efd89e1650f10ecce175112afd920b
Jun 02 01:50:30.912910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:30.912870    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv" event={"ID":"d0d28bbe-1bc6-4d5e-a110-4f10837361b1","Type":"ContainerStarted","Data":"2c9ed8d2e5658e9a391fb6ffc897975668e1e999f0cba4ee9e29c88e7fda5a8f"}
Jun 02 01:50:30.912910 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:30.912914    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv" event={"ID":"d0d28bbe-1bc6-4d5e-a110-4f10837361b1","Type":"ContainerStarted","Data":"038f1d0a75a2b1535297cc04be4ad69163efd89e1650f10ecce175112afd920b"}
Jun 02 01:50:30.913312 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:30.912971    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:30.936855 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:30.936815    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv" podStartSLOduration=1.936802731 podStartE2EDuration="1.936802731s" podCreationTimestamp="2026-06-02 01:50:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:30.934549789 +0000 UTC m=+590.311801319" watchObservedRunningTime="2026-06-02 01:50:30.936802731 +0000 UTC m=+590.314054259"
Jun 02 01:50:40.915862 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:40.915834    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:41.137293 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:41.137268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:50:41.137768 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:41.137748    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:50:41.918395 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:41.918365    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rjrvv"
Jun 02 01:50:42.042957 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.042923    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:42.043175 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.043132    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" podUID="8368a052-8817-4227-ae51-9f89306e87c3" containerName="manager" containerID="cri-o://487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2" gracePeriod=10
Jun 02 01:50:42.295356 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.295335    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:42.346553 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.346494    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbhwq\" (UniqueName: \"kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq\") pod \"8368a052-8817-4227-ae51-9f89306e87c3\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") "
Jun 02 01:50:42.346712 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.346605    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume\") pod \"8368a052-8817-4227-ae51-9f89306e87c3\" (UID: \"8368a052-8817-4227-ae51-9f89306e87c3\") "
Jun 02 01:50:42.346938 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.346915    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8368a052-8817-4227-ae51-9f89306e87c3" (UID: "8368a052-8817-4227-ae51-9f89306e87c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:50:42.348251 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.348230    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq" (OuterVolumeSpecName: "kube-api-access-pbhwq") pod "8368a052-8817-4227-ae51-9f89306e87c3" (UID: "8368a052-8817-4227-ae51-9f89306e87c3"). InnerVolumeSpecName "kube-api-access-pbhwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:50:42.447519 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.447469    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbhwq\" (UniqueName: \"kubernetes.io/projected/8368a052-8817-4227-ae51-9f89306e87c3-kube-api-access-pbhwq\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:50:42.447519 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.447516    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8368a052-8817-4227-ae51-9f89306e87c3-extensions-socket-volume\") on node \"ip-10-0-129-109.ec2.internal\" DevicePath \"\""
Jun 02 01:50:42.953257 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.953223    2562 generic.go:358] "Generic (PLEG): container finished" podID="8368a052-8817-4227-ae51-9f89306e87c3" containerID="487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2" exitCode=0
Jun 02 01:50:42.953733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.953291    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"
Jun 02 01:50:42.953733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.953292    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" event={"ID":"8368a052-8817-4227-ae51-9f89306e87c3","Type":"ContainerDied","Data":"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"}
Jun 02 01:50:42.953733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.953394    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4" event={"ID":"8368a052-8817-4227-ae51-9f89306e87c3","Type":"ContainerDied","Data":"3e9f78701546c5fb6733f5f782d93c1518c707d6c271b7889b8b62cfcec58495"}
Jun 02 01:50:42.953733 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.953409    2562 scope.go:117] "RemoveContainer" containerID="487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"
Jun 02 01:50:42.961380 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.961363    2562 scope.go:117] "RemoveContainer" containerID="487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"
Jun 02 01:50:42.961644 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:50:42.961624    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2\": container with ID starting with 487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2 not found: ID does not exist" containerID="487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"
Jun 02 01:50:42.961709 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.961651    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2"} err="failed to get container status \"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2\": rpc error: code = NotFound desc = could not find container \"487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2\": container with ID starting with 487c4d7763b47250fd8d647ca23634689d33c156e37b4d234b5eaaf1f8a836f2 not found: ID does not exist"
Jun 02 01:50:42.984368 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.984346    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:42.989112 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:42.989093    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tzfz4"]
Jun 02 01:50:43.156851 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:43.156821    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8368a052-8817-4227-ae51-9f89306e87c3" path="/var/lib/kubelet/pods/8368a052-8817-4227-ae51-9f89306e87c3/volumes"
Jun 02 01:50:58.291864 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.291833    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"]
Jun 02 01:50:58.295518 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.292146    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8368a052-8817-4227-ae51-9f89306e87c3" containerName="manager"
Jun 02 01:50:58.295518 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.292156    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8368a052-8817-4227-ae51-9f89306e87c3" containerName="manager"
Jun 02 01:50:58.295518 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.292225    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="8368a052-8817-4227-ae51-9f89306e87c3" containerName="manager"
Jun 02 01:50:58.295518 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.295511    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.298480 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.298459    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lt9mn\""
Jun 02 01:50:58.308773 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.308749    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"]
Jun 02 01:50:58.370196 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370300 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5t5l\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-kube-api-access-k5t5l\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370300 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370379 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370379 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370379 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370471 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370471 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.370471 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.370456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.471902 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471871    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471912    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471929    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471972    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.471994    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472031 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472016    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472317 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472066    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472372 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472372 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472347    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472473 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472369    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5t5l\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-kube-api-access-k5t5l\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472625 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472584    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472728 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.472790 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.472743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.474271 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.474243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.474542 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.474525    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.479823 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.479799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.480053 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.480033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5t5l\" (UniqueName: \"kubernetes.io/projected/9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b-kube-api-access-k5t5l\") pod \"maas-default-gateway-openshift-default-7df95f575-fxj8k\" (UID: \"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.605946 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.605864    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:58.743676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.743648    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"]
Jun 02 01:50:58.752979 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.751822    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:50:58.752979 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.751984    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:50:58.752979 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:58.752088    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 02 01:50:59.007728 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:59.007681    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k" event={"ID":"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b","Type":"ContainerStarted","Data":"4848a2aeef0d587f1dd772658a5b5ad8223cd034d2ed4da537b613d64cabbc53"}
Jun 02 01:50:59.007728 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:59.007732    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k" event={"ID":"9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b","Type":"ContainerStarted","Data":"904653af88adb978899e17872f64113653588c868083895c4bf565e700d7c754"}
Jun 02 01:50:59.034123 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:59.034077    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k" podStartSLOduration=1.034061686 podStartE2EDuration="1.034061686s" podCreationTimestamp="2026-06-02 01:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:59.03223414 +0000 UTC m=+618.409485672" watchObservedRunningTime="2026-06-02 01:50:59.034061686 +0000 UTC m=+618.411313278"
Jun 02 01:50:59.606293 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:59.606257    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:50:59.610906 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:50:59.610884    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:51:00.011194 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:00.011166    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:51:00.012048 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:00.012017    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-fxj8k"
Jun 02 01:51:03.098795 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.098763    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:51:03.101939 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.101920    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.104650 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.104620    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 02 01:51:03.104755 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.104701    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p7wkp\""
Jun 02 01:51:03.109441 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.109114    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:51:03.140342 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.140311    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:51:03.217834 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.217807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de525f83-1283-46db-a2db-662bb9a54617-config-file\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.217940 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.217862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzf6\" (UniqueName: \"kubernetes.io/projected/de525f83-1283-46db-a2db-662bb9a54617-kube-api-access-2bzf6\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.319228 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.319199    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzf6\" (UniqueName: \"kubernetes.io/projected/de525f83-1283-46db-a2db-662bb9a54617-kube-api-access-2bzf6\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.319348 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.319263    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de525f83-1283-46db-a2db-662bb9a54617-config-file\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.319806 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.319790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de525f83-1283-46db-a2db-662bb9a54617-config-file\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.327221 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.327195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzf6\" (UniqueName: \"kubernetes.io/projected/de525f83-1283-46db-a2db-662bb9a54617-kube-api-access-2bzf6\") pod \"limitador-limitador-78c99df468-g59bl\" (UID: \"de525f83-1283-46db-a2db-662bb9a54617\") " pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.413763 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.413702    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:03.538535 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:03.538497    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:51:03.540605 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:51:03.540577    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde525f83_1283_46db_a2db_662bb9a54617.slice/crio-048fff763c43830f4da1b4082ca842c2f62333496c6dd758de99d45893ca5d73 WatchSource:0}: Error finding container 048fff763c43830f4da1b4082ca842c2f62333496c6dd758de99d45893ca5d73: Status 404 returned error can't find the container with id 048fff763c43830f4da1b4082ca842c2f62333496c6dd758de99d45893ca5d73
Jun 02 01:51:04.027177 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:04.026878    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl" event={"ID":"de525f83-1283-46db-a2db-662bb9a54617","Type":"ContainerStarted","Data":"048fff763c43830f4da1b4082ca842c2f62333496c6dd758de99d45893ca5d73"}
Jun 02 01:51:06.035346 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:06.035321    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl" event={"ID":"de525f83-1283-46db-a2db-662bb9a54617","Type":"ContainerStarted","Data":"5cc9961f59b637e1f4dfaccdc656ce32d2b94fd49f0c1afeb17d922b6f642129"}
Jun 02 01:51:06.035672 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:06.035422    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:51:06.053627 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:06.053579    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl" podStartSLOduration=0.635920446 podStartE2EDuration="3.053567341s" podCreationTimestamp="2026-06-02 01:51:03 +0000 UTC" firstStartedPulling="2026-06-02 01:51:03.542416272 +0000 UTC m=+622.919667779" lastFinishedPulling="2026-06-02 01:51:05.960063164 +0000 UTC m=+625.337314674" observedRunningTime="2026-06-02 01:51:06.051572697 +0000 UTC m=+625.428824226" watchObservedRunningTime="2026-06-02 01:51:06.053567341 +0000 UTC m=+625.430818869"
Jun 02 01:51:17.040190 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:51:17.040162    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-g59bl"
Jun 02 01:53:00.123766 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.123725    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"]
Jun 02 01:53:00.127474 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.127451    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:00.130403 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.130384    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t4l8s\""
Jun 02 01:53:00.130528 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.130445    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 02 01:53:00.134301 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.134277    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"]
Jun 02 01:53:00.162285 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.162256    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"]
Jun 02 01:53:00.165390 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.165376    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:00.176072 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.176053    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"]
Jun 02 01:53:00.225823 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.225792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46bv\" (UniqueName: \"kubernetes.io/projected/b4c570e8-45e3-4bc6-b2cc-1612f970008c-kube-api-access-c46bv\") pod \"payload-processing-58b6c8fdc7-g6jqp\" (UID: \"b4c570e8-45e3-4bc6-b2cc-1612f970008c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:00.261836 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.261810    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:53:00.326656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.326623    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c46bv\" (UniqueName: \"kubernetes.io/projected/b4c570e8-45e3-4bc6-b2cc-1612f970008c-kube-api-access-c46bv\") pod \"payload-processing-58b6c8fdc7-g6jqp\" (UID: \"b4c570e8-45e3-4bc6-b2cc-1612f970008c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:00.326790 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.326684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s9ct\" (UniqueName: \"kubernetes.io/projected/4e8fbb84-6b89-4945-9a13-2031bf11ee78-kube-api-access-4s9ct\") pod \"payload-pre-processing-75d9d88b9-vwfgp\" (UID: \"4e8fbb84-6b89-4945-9a13-2031bf11ee78\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:00.337560 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.337535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46bv\" (UniqueName: \"kubernetes.io/projected/b4c570e8-45e3-4bc6-b2cc-1612f970008c-kube-api-access-c46bv\") pod \"payload-processing-58b6c8fdc7-g6jqp\" (UID: \"b4c570e8-45e3-4bc6-b2cc-1612f970008c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:00.427619 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.427527    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s9ct\" (UniqueName: \"kubernetes.io/projected/4e8fbb84-6b89-4945-9a13-2031bf11ee78-kube-api-access-4s9ct\") pod \"payload-pre-processing-75d9d88b9-vwfgp\" (UID: \"4e8fbb84-6b89-4945-9a13-2031bf11ee78\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:00.436269 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.436223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s9ct\" (UniqueName: \"kubernetes.io/projected/4e8fbb84-6b89-4945-9a13-2031bf11ee78-kube-api-access-4s9ct\") pod \"payload-pre-processing-75d9d88b9-vwfgp\" (UID: \"4e8fbb84-6b89-4945-9a13-2031bf11ee78\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:00.440039 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.440018    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:00.474829 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.474800    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:00.577350 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.577319    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"]
Jun 02 01:53:00.581186 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:53:00.581155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8fbb84_6b89_4945_9a13_2031bf11ee78.slice/crio-56574ae8bb4788cdc98e7f571b26f685c231e9f6fd557db10d9f1a330e8b60be WatchSource:0}: Error finding container 56574ae8bb4788cdc98e7f571b26f685c231e9f6fd557db10d9f1a330e8b60be: Status 404 returned error can't find the container with id 56574ae8bb4788cdc98e7f571b26f685c231e9f6fd557db10d9f1a330e8b60be
Jun 02 01:53:00.583342 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.583322    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 01:53:00.619656 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:00.619425    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"]
Jun 02 01:53:00.623573 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:53:00.623543    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c570e8_45e3_4bc6_b2cc_1612f970008c.slice/crio-4d18c63f2935d6e6a2685f6e1f972f8620549c6d103d8f7bdeb868bee0f6c2c9 WatchSource:0}: Error finding container 4d18c63f2935d6e6a2685f6e1f972f8620549c6d103d8f7bdeb868bee0f6c2c9: Status 404 returned error can't find the container with id 4d18c63f2935d6e6a2685f6e1f972f8620549c6d103d8f7bdeb868bee0f6c2c9
Jun 02 01:53:01.420863 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:01.420779    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp" event={"ID":"b4c570e8-45e3-4bc6-b2cc-1612f970008c","Type":"ContainerStarted","Data":"4d18c63f2935d6e6a2685f6e1f972f8620549c6d103d8f7bdeb868bee0f6c2c9"}
Jun 02 01:53:01.422375 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:01.422342    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp" event={"ID":"4e8fbb84-6b89-4945-9a13-2031bf11ee78","Type":"ContainerStarted","Data":"56574ae8bb4788cdc98e7f571b26f685c231e9f6fd557db10d9f1a330e8b60be"}
Jun 02 01:53:04.433297 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.433250    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp" event={"ID":"4e8fbb84-6b89-4945-9a13-2031bf11ee78","Type":"ContainerStarted","Data":"ec0c50199a1f3604bcc993d498c35f37ec4ad93d97d987fde3588ce8d9c31b18"}
Jun 02 01:53:04.433724 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.433353    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:53:04.434635 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.434613    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp" event={"ID":"b4c570e8-45e3-4bc6-b2cc-1612f970008c","Type":"ContainerStarted","Data":"8cbfd77ea703d94e857a6ac6e60403fd837c3c1c37ff36c6c42c33ffbc08b324"}
Jun 02 01:53:04.434710 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.434660    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:04.452337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.452289    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp" podStartSLOduration=1.576258103 podStartE2EDuration="4.452277019s" podCreationTimestamp="2026-06-02 01:53:00 +0000 UTC" firstStartedPulling="2026-06-02 01:53:00.58352046 +0000 UTC m=+739.960771972" lastFinishedPulling="2026-06-02 01:53:03.45953938 +0000 UTC m=+742.836790888" observedRunningTime="2026-06-02 01:53:04.449816614 +0000 UTC m=+743.827068143" watchObservedRunningTime="2026-06-02 01:53:04.452277019 +0000 UTC m=+743.829528547"
Jun 02 01:53:04.465462 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:04.465421    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp" podStartSLOduration=1.637808862 podStartE2EDuration="4.465409298s" podCreationTimestamp="2026-06-02 01:53:00 +0000 UTC" firstStartedPulling="2026-06-02 01:53:00.625354814 +0000 UTC m=+740.002606335" lastFinishedPulling="2026-06-02 01:53:03.452955261 +0000 UTC m=+742.830206771" observedRunningTime="2026-06-02 01:53:04.464550982 +0000 UTC m=+743.841802511" watchObservedRunningTime="2026-06-02 01:53:04.465409298 +0000 UTC m=+743.842660824"
Jun 02 01:53:15.440289 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:15.440260    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-g6jqp"
Jun 02 01:53:15.440713 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:53:15.440308    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-vwfgp"
Jun 02 01:54:02.116090 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.116018    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"]
Jun 02 01:54:02.124888 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.124860    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.128278 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.128252    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4c4k9\""
Jun 02 01:54:02.128445 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.128347    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 02 01:54:02.128541 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.128464    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 02 01:54:02.128628 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.128409    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 02 01:54:02.129394 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.129370    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"]
Jun 02 01:54:02.156337 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.156438 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.156438 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6w5\" (UniqueName: \"kubernetes.io/projected/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kube-api-access-7t6w5\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.156438 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.156623 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.156677 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.156624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.257716 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257693    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6w5\" (UniqueName: \"kubernetes.io/projected/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kube-api-access-7t6w5\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.257840 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257725    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.257840 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257792    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.257840 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257809    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.257840 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257825    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.258029 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.257846    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.258180 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.258159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.258303 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.258277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.258394 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.258308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.260353 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.260330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.260536 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.260517    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.266283 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.266257    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6w5\" (UniqueName: \"kubernetes.io/projected/30ebd46c-49b1-4a31-a7fc-1948ac03c22f-kube-api-access-7t6w5\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl\" (UID: \"30ebd46c-49b1-4a31-a7fc-1948ac03c22f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.436574 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.436470    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:02.539676 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.539646    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:54:02.567784 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.567761    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"]
Jun 02 01:54:02.569935 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:54:02.569909    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ebd46c_49b1_4a31_a7fc_1948ac03c22f.slice/crio-eb2cc3c9138a1d18601cede5219462a015bbfab0c66d9c83648c983cb9461a55 WatchSource:0}: Error finding container eb2cc3c9138a1d18601cede5219462a015bbfab0c66d9c83648c983cb9461a55: Status 404 returned error can't find the container with id eb2cc3c9138a1d18601cede5219462a015bbfab0c66d9c83648c983cb9461a55
Jun 02 01:54:02.632280 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:02.632250    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl" event={"ID":"30ebd46c-49b1-4a31-a7fc-1948ac03c22f","Type":"ContainerStarted","Data":"eb2cc3c9138a1d18601cede5219462a015bbfab0c66d9c83648c983cb9461a55"}
Jun 02 01:54:06.653772 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:06.653735    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl" event={"ID":"30ebd46c-49b1-4a31-a7fc-1948ac03c22f","Type":"ContainerStarted","Data":"c4e65406fa1b61efdac4c677cfbca1db4f341c1ce5cd5ce9ffaf1894f9a0a9b9"}
Jun 02 01:54:07.658782 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:07.658737    2562 generic.go:358] "Generic (PLEG): container finished" podID="30ebd46c-49b1-4a31-a7fc-1948ac03c22f" containerID="c4e65406fa1b61efdac4c677cfbca1db4f341c1ce5cd5ce9ffaf1894f9a0a9b9" exitCode=0
Jun 02 01:54:07.659179 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:07.658802    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl" event={"ID":"30ebd46c-49b1-4a31-a7fc-1948ac03c22f","Type":"ContainerDied","Data":"c4e65406fa1b61efdac4c677cfbca1db4f341c1ce5cd5ce9ffaf1894f9a0a9b9"}
Jun 02 01:54:09.670635 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:09.670602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl" event={"ID":"30ebd46c-49b1-4a31-a7fc-1948ac03c22f","Type":"ContainerStarted","Data":"cc3925ecb2012a7fed72242bc06b9026315a959c6814cee125d174e996103ebc"}
Jun 02 01:54:09.688989 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:09.688933    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl" podStartSLOduration=1.5332226119999999 podStartE2EDuration="7.688919415s" podCreationTimestamp="2026-06-02 01:54:02 +0000 UTC" firstStartedPulling="2026-06-02 01:54:02.571718434 +0000 UTC m=+801.948969941" lastFinishedPulling="2026-06-02 01:54:08.727415227 +0000 UTC m=+808.104666744" observedRunningTime="2026-06-02 01:54:09.688112113 +0000 UTC m=+809.065363643" watchObservedRunningTime="2026-06-02 01:54:09.688919415 +0000 UTC m=+809.066170944"
Jun 02 01:54:12.436861 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:12.436815    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:12.436861 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:12.436863    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:12.450832 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:12.450800    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:12.692977 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:12.692907    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl"
Jun 02 01:54:15.642363 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:15.642312    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:54:19.468478 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.467883    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"]
Jun 02 01:54:19.674609 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.674574    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"]
Jun 02 01:54:19.674772 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.674702    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.677813 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.677788    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 02 01:54:19.824163 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.824329 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.824329 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.824329 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqz5h\" (UniqueName: \"kubernetes.io/projected/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kube-api-access-fqz5h\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.824452 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.824452 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.824362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925616 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925581    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925658    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925693    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925709    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqz5h\" (UniqueName: \"kubernetes.io/projected/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kube-api-access-fqz5h\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.925762 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.925754    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.926066 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.926037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.926176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.926073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.926176 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.926100    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.927938 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.927916    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.928134 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.928116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.933902 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.933884    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqz5h\" (UniqueName: \"kubernetes.io/projected/d4a417d0-9d5f-470a-bc71-7f03c59ef83e-kube-api-access-fqz5h\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt\" (UID: \"d4a417d0-9d5f-470a-bc71-7f03c59ef83e\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:19.985991 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:19.985957    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:20.120444 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:20.120419    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"]
Jun 02 01:54:20.122509 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:54:20.122466    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a417d0_9d5f_470a_bc71_7f03c59ef83e.slice/crio-a791718f6fa3d7d96254d5d941bc22d530e1bf084328f3c5ba538e9d6661b489 WatchSource:0}: Error finding container a791718f6fa3d7d96254d5d941bc22d530e1bf084328f3c5ba538e9d6661b489: Status 404 returned error can't find the container with id a791718f6fa3d7d96254d5d941bc22d530e1bf084328f3c5ba538e9d6661b489
Jun 02 01:54:20.148090 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:20.148060    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:54:20.709952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:20.709918    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt" event={"ID":"d4a417d0-9d5f-470a-bc71-7f03c59ef83e","Type":"ContainerStarted","Data":"144440f0f001ce457ee35090a2fdeb0bce747efb37a9d3ef67eca5c46a35234e"}
Jun 02 01:54:20.709952 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:20.709951    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt" event={"ID":"d4a417d0-9d5f-470a-bc71-7f03c59ef83e","Type":"ContainerStarted","Data":"a791718f6fa3d7d96254d5d941bc22d530e1bf084328f3c5ba538e9d6661b489"}
Jun 02 01:54:21.714713 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:21.714619    2562 generic.go:358] "Generic (PLEG): container finished" podID="d4a417d0-9d5f-470a-bc71-7f03c59ef83e" containerID="144440f0f001ce457ee35090a2fdeb0bce747efb37a9d3ef67eca5c46a35234e" exitCode=0
Jun 02 01:54:21.714713 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:21.714665    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt" event={"ID":"d4a417d0-9d5f-470a-bc71-7f03c59ef83e","Type":"ContainerDied","Data":"144440f0f001ce457ee35090a2fdeb0bce747efb37a9d3ef67eca5c46a35234e"}
Jun 02 01:54:22.719747 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:22.719716    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt" event={"ID":"d4a417d0-9d5f-470a-bc71-7f03c59ef83e","Type":"ContainerStarted","Data":"58617a7a9873463eab85853fa14a01cdaf443b8944c725da863d440589bb36bc"}
Jun 02 01:54:22.742763 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:22.742698    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt" podStartSLOduration=3.579199424 podStartE2EDuration="3.742677238s" podCreationTimestamp="2026-06-02 01:54:19 +0000 UTC" firstStartedPulling="2026-06-02 01:54:21.71520036 +0000 UTC m=+821.092451867" lastFinishedPulling="2026-06-02 01:54:21.878678174 +0000 UTC m=+821.255929681" observedRunningTime="2026-06-02 01:54:22.739849585 +0000 UTC m=+822.117101147" watchObservedRunningTime="2026-06-02 01:54:22.742677238 +0000 UTC m=+822.119928859"
Jun 02 01:54:25.695544 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.695491    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"]
Jun 02 01:54:25.699026 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.699002    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.701932 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.701906    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 02 01:54:25.709132 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.708643    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"]
Jun 02 01:54:25.780456 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.780628 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.780628 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.780628 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e98f71-9e62-4111-818b-cab9260a35fc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.780753 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.780753 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.780693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwpd4\" (UniqueName: \"kubernetes.io/projected/07e98f71-9e62-4111-818b-cab9260a35fc-kube-api-access-bwpd4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881375 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881344    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881387    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881408    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881444    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e98f71-9e62-4111-818b-cab9260a35fc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881473    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881581 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881489    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwpd4\" (UniqueName: \"kubernetes.io/projected/07e98f71-9e62-4111-818b-cab9260a35fc-kube-api-access-bwpd4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881855 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881841    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.881915 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.881876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.882185 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.882164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.883777 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.883755    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e98f71-9e62-4111-818b-cab9260a35fc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.884065 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.884049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e98f71-9e62-4111-818b-cab9260a35fc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:25.889930 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:25.889905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwpd4\" (UniqueName: \"kubernetes.io/projected/07e98f71-9e62-4111-818b-cab9260a35fc-kube-api-access-bwpd4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2\" (UID: \"07e98f71-9e62-4111-818b-cab9260a35fc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:26.012609 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:26.012583    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:26.144697 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:26.144671    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"]
Jun 02 01:54:26.146610 ip-10-0-129-109 kubenswrapper[2562]: W0602 01:54:26.146571    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e98f71_9e62_4111_818b_cab9260a35fc.slice/crio-b611e588ba5b8c9e051d244deae0bf915334c221d5fbea2623efdb9953651e96 WatchSource:0}: Error finding container b611e588ba5b8c9e051d244deae0bf915334c221d5fbea2623efdb9953651e96: Status 404 returned error can't find the container with id b611e588ba5b8c9e051d244deae0bf915334c221d5fbea2623efdb9953651e96
Jun 02 01:54:26.733962 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:26.733921    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2" event={"ID":"07e98f71-9e62-4111-818b-cab9260a35fc","Type":"ContainerStarted","Data":"9f0300d78927dddd1d0d27cd710a85ffca9ac0bd1d33d7f0905939667e41ee48"}
Jun 02 01:54:26.733962 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:26.733966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2" event={"ID":"07e98f71-9e62-4111-818b-cab9260a35fc","Type":"ContainerStarted","Data":"b611e588ba5b8c9e051d244deae0bf915334c221d5fbea2623efdb9953651e96"}
Jun 02 01:54:26.738873 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:26.738843    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:54:27.604646 ip-10-0-129-109 kubenswrapper[2562]: E0602 01:54:27.604611    2562 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e98f71_9e62_4111_818b_cab9260a35fc.slice/crio-9f0300d78927dddd1d0d27cd710a85ffca9ac0bd1d33d7f0905939667e41ee48.scope\": RecentStats: unable to find data in memory cache]"
Jun 02 01:54:27.739574 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:27.739533    2562 generic.go:358] "Generic (PLEG): container finished" podID="07e98f71-9e62-4111-818b-cab9260a35fc" containerID="9f0300d78927dddd1d0d27cd710a85ffca9ac0bd1d33d7f0905939667e41ee48" exitCode=0
Jun 02 01:54:27.739971 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:27.739599    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2" event={"ID":"07e98f71-9e62-4111-818b-cab9260a35fc","Type":"ContainerDied","Data":"9f0300d78927dddd1d0d27cd710a85ffca9ac0bd1d33d7f0905939667e41ee48"}
Jun 02 01:54:28.745095 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:28.745059    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2" event={"ID":"07e98f71-9e62-4111-818b-cab9260a35fc","Type":"ContainerStarted","Data":"81cbdc9f0ed813e8cae863623ed6ee40f91d44452e799dabaef8a8b6d866662f"}
Jun 02 01:54:28.765391 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:28.765339    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2" podStartSLOduration=3.574711777 podStartE2EDuration="3.765321487s" podCreationTimestamp="2026-06-02 01:54:25 +0000 UTC" firstStartedPulling="2026-06-02 01:54:27.740166386 +0000 UTC m=+827.117417894" lastFinishedPulling="2026-06-02 01:54:27.930776097 +0000 UTC m=+827.308027604" observedRunningTime="2026-06-02 01:54:28.764256487 +0000 UTC m=+828.141507998" watchObservedRunningTime="2026-06-02 01:54:28.765321487 +0000 UTC m=+828.142573013"
Jun 02 01:54:29.986330 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:29.986287    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:29.986330 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:29.986329    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:29.999216 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:29.999192    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:30.763191 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:30.763160    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt"
Jun 02 01:54:36.012849 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:36.012817    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:36.013287 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:36.012862    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:36.029597 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:36.026376    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:36.784276 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:36.784245    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2"
Jun 02 01:54:37.641633 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:37.641594    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:54:50.465283 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:54:50.465243    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-g59bl"]
Jun 02 01:55:41.162235 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:55:41.162204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 01:55:41.164856 ip-10-0-129-109 kubenswrapper[2562]: I0602 01:55:41.164832    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 02:00:36.514085 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:36.514049    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f9c748996-gk4wp_441cc249-25e2-4139-b7a7-07694d6b7415/nginx/0.log"
Jun 02 02:00:37.392406 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:37.392379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6_75a2d504-efc1-44bb-8919-f29eb76e9357/copy-manifests/0.log"
Jun 02 02:00:37.402016 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:37.401992    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6_75a2d504-efc1-44bb-8919-f29eb76e9357/manager/0.log"
Jun 02 02:00:39.114563 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:39.114531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dhmnp_e4582c7d-acb5-4286-856b-5b4d3ebdfe62/manager/0.log"
Jun 02 02:00:39.454167 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:39.454087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nlclh_59f98e65-d550-4fdd-b588-0979f7c77b76/registry-server/0.log"
Jun 02 02:00:39.572703 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:39.572674    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rjrvv_d0d28bbe-1bc6-4d5e-a110-4f10837361b1/manager/0.log"
Jun 02 02:00:39.687414 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:39.687386    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-g59bl_de525f83-1283-46db-a2db-662bb9a54617/limitador/0.log"
Jun 02 02:00:40.125434 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:40.125405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8rlwqn_dd2bca46-5c78-4139-83b8-f6f158a996e2/istio-proxy/0.log"
Jun 02 02:00:40.583787 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:40.583760    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-fxj8k_9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b/istio-proxy/0.log"
Jun 02 02:00:40.697142 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:40.697113    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-vwfgp_4e8fbb84-6b89-4945-9a13-2031bf11ee78/payload-pre-processing/0.log"
Jun 02 02:00:40.820023 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:40.819999    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-g6jqp_b4c570e8-45e3-4bc6-b2cc-1612f970008c/payload-processing/0.log"
Jun 02 02:00:41.193830 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.193799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 02:00:41.194891 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.194866    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cg9l_db4cc45a-bc2c-4eaf-a328-a4f4f857ae9a/ovn-acl-logging/0.log"
Jun 02 02:00:41.271050 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.271021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl_30ebd46c-49b1-4a31-a7fc-1948ac03c22f/storage-initializer/0.log"
Jun 02 02:00:41.279587 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.279570    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-n5lnl_30ebd46c-49b1-4a31-a7fc-1948ac03c22f/main/0.log"
Jun 02 02:00:41.529622 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.529575    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt_d4a417d0-9d5f-470a-bc71-7f03c59ef83e/storage-initializer/0.log"
Jun 02 02:00:41.537782 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.537763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-fwmrt_d4a417d0-9d5f-470a-bc71-7f03c59ef83e/main/0.log"
Jun 02 02:00:41.648045 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.648007    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2_07e98f71-9e62-4111-818b-cab9260a35fc/storage-initializer/0.log"
Jun 02 02:00:41.655896 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:41.655869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rxhx2_07e98f71-9e62-4111-818b-cab9260a35fc/main/0.log"
Jun 02 02:00:49.179283 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:49.179253    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9n6jp_d4c9ad68-9361-49c7-a2a4-795175ab6159/global-pull-secret-syncer/0.log"
Jun 02 02:00:49.406978 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:49.406947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hgx2j_99eb08d7-52a3-4184-a97f-ba0d08f5ae3c/konnectivity-agent/0.log"
Jun 02 02:00:49.437040 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:49.436963    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-109.ec2.internal_1cf0e2e5f90b2e7a259d62b92d25592d/haproxy/0.log"
Jun 02 02:00:54.043271 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:54.043243    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dhmnp_e4582c7d-acb5-4286-856b-5b4d3ebdfe62/manager/0.log"
Jun 02 02:00:54.138031 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:54.137998    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nlclh_59f98e65-d550-4fdd-b588-0979f7c77b76/registry-server/0.log"
Jun 02 02:00:54.185768 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:54.185739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rjrvv_d0d28bbe-1bc6-4d5e-a110-4f10837361b1/manager/0.log"
Jun 02 02:00:54.212516 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:54.212439    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-g59bl_de525f83-1283-46db-a2db-662bb9a54617/limitador/0.log"
Jun 02 02:00:56.013339 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.013311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-6wg4z_b5596ee6-3615-480f-b26e-d1ffc80969b6/cluster-monitoring-operator/0.log"
Jun 02 02:00:56.157621 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.157590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-785d5d97fd-c5699_fa8c4c69-6b4b-4d7e-a466-cf6a70c8e0f2/metrics-server/0.log"
Jun 02 02:00:56.224242 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.224216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tkzs_9241381e-ccc6-4810-8aac-e1641c647b11/node-exporter/0.log"
Jun 02 02:00:56.249816 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.249794    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tkzs_9241381e-ccc6-4810-8aac-e1641c647b11/kube-rbac-proxy/0.log"
Jun 02 02:00:56.288187 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.288121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tkzs_9241381e-ccc6-4810-8aac-e1641c647b11/init-textfile/0.log"
Jun 02 02:00:56.731834 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.731805    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/prometheus/0.log"
Jun 02 02:00:56.757877 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.757851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/config-reloader/0.log"
Jun 02 02:00:56.786278 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.786256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/thanos-sidecar/0.log"
Jun 02 02:00:56.812352 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.812332    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/kube-rbac-proxy-web/0.log"
Jun 02 02:00:56.839673 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.839652    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/kube-rbac-proxy/0.log"
Jun 02 02:00:56.866440 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.866420    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/kube-rbac-proxy-thanos/0.log"
Jun 02 02:00:56.895947 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.895930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ce9d79-08ef-4d09-9933-5ea627dfc6b4/init-config-reloader/0.log"
Jun 02 02:00:56.926854 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.926834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-xkbxc_226e6f20-37b0-462c-8d5a-de15f1ca0851/prometheus-operator/0.log"
Jun 02 02:00:56.952531 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.952513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-xkbxc_226e6f20-37b0-462c-8d5a-de15f1ca0851/kube-rbac-proxy/0.log"
Jun 02 02:00:56.982268 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:56.982214    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-5s597_4cbcda7a-ea35-4fa2-8a8c-bd788a30aa89/prometheus-operator-admission-webhook/0.log"
Jun 02 02:00:58.728077 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.728040    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"]
Jun 02 02:00:58.731717 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.731693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.749753 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.749729    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7ftlk\"/\"default-dockercfg-gns69\""
Jun 02 02:00:58.750214 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.750199    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ftlk\"/\"openshift-service-ca.crt\""
Jun 02 02:00:58.751185 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.751169    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ftlk\"/\"kube-root-ca.crt\""
Jun 02 02:00:58.759540 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.759519    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"]
Jun 02 02:00:58.872217 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.872186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6mp9\" (UniqueName: \"kubernetes.io/projected/275662be-f918-48c3-99fc-d1e6356234e1-kube-api-access-h6mp9\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.872368 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.872240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-proc\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.872368 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.872281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-lib-modules\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.872368 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.872357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-sys\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.872463 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.872389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-podres\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973044 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973010    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-sys\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973055    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-podres\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973115    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6mp9\" (UniqueName: \"kubernetes.io/projected/275662be-f918-48c3-99fc-d1e6356234e1-kube-api-access-h6mp9\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-sys\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973183    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-proc\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973202    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-lib-modules\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973277 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-podres\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973565 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-proc\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.973565 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.973311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275662be-f918-48c3-99fc-d1e6356234e1-lib-modules\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:58.984223 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:58.984168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6mp9\" (UniqueName: \"kubernetes.io/projected/275662be-f918-48c3-99fc-d1e6356234e1-kube-api-access-h6mp9\") pod \"perf-node-gather-daemonset-ds59b\" (UID: \"275662be-f918-48c3-99fc-d1e6356234e1\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:59.040912 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:59.040884    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:00:59.185587 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:59.185562    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"]
Jun 02 02:00:59.187934 ip-10-0-129-109 kubenswrapper[2562]: W0602 02:00:59.187902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod275662be_f918_48c3_99fc_d1e6356234e1.slice/crio-054eb1454f1e7185ad0c3d9ec924ddc124e02c87a52f07e8ffb0f23d93e4ecf8 WatchSource:0}: Error finding container 054eb1454f1e7185ad0c3d9ec924ddc124e02c87a52f07e8ffb0f23d93e4ecf8: Status 404 returned error can't find the container with id 054eb1454f1e7185ad0c3d9ec924ddc124e02c87a52f07e8ffb0f23d93e4ecf8
Jun 02 02:00:59.189496 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:59.189479    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 02:00:59.504428 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:00:59.504385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-kcrtl_c255a191-6662-48a5-8772-fb5eff7bc275/download-server/0.log"
Jun 02 02:01:00.128060 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.128021    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b" event={"ID":"275662be-f918-48c3-99fc-d1e6356234e1","Type":"ContainerStarted","Data":"64ee58a1528cb3c73c0d83ef2c2f1691ad607d44d23a60b30e5d86c3418cec93"}
Jun 02 02:01:00.128060 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.128061    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b" event={"ID":"275662be-f918-48c3-99fc-d1e6356234e1","Type":"ContainerStarted","Data":"054eb1454f1e7185ad0c3d9ec924ddc124e02c87a52f07e8ffb0f23d93e4ecf8"}
Jun 02 02:01:00.128618 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.128120    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:01:00.146007 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.145964    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b" podStartSLOduration=2.1459515590000002 podStartE2EDuration="2.145951559s" podCreationTimestamp="2026-06-02 02:00:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:01:00.144581882 +0000 UTC m=+1219.521833424" watchObservedRunningTime="2026-06-02 02:01:00.145951559 +0000 UTC m=+1219.523203088"
Jun 02 02:01:00.905471 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.905445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gnwvv_355f7a90-9071-49a0-82ea-5424317090dc/dns/0.log"
Jun 02 02:01:00.929216 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.929194    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gnwvv_355f7a90-9071-49a0-82ea-5424317090dc/kube-rbac-proxy/0.log"
Jun 02 02:01:00.955609 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:00.955590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrrrf_3c31d2b1-dc03-4e5e-ac40-26dcc7605448/dns-node-resolver/0.log"
Jun 02 02:01:01.621355 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:01.621324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xlzh6_0f765a2e-2911-4391-8e7f-5ef7d59726eb/node-ca/0.log"
Jun 02 02:01:02.542557 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:02.542530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8rlwqn_dd2bca46-5c78-4139-83b8-f6f158a996e2/istio-proxy/0.log"
Jun 02 02:01:02.694918 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:02.694894    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-fxj8k_9ce7d0cd-74db-41b0-bfe1-0f81ea854c7b/istio-proxy/0.log"
Jun 02 02:01:02.730242 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:02.730213    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-vwfgp_4e8fbb84-6b89-4945-9a13-2031bf11ee78/payload-pre-processing/0.log"
Jun 02 02:01:02.759852 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:02.759829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-g6jqp_b4c570e8-45e3-4bc6-b2cc-1612f970008c/payload-processing/0.log"
Jun 02 02:01:03.363873 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:03.363844    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghlkg_6d57f3a2-84e1-4d01-9654-cc21b15f5293/serve-healthcheck-canary/0.log"
Jun 02 02:01:03.940833 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:03.940806    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-ddxc8_1b86b8cd-614d-4e37-aa02-70aa09c53e2d/insights-operator/0.log"
Jun 02 02:01:03.940833 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:03.940822    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-ddxc8_1b86b8cd-614d-4e37-aa02-70aa09c53e2d/insights-operator/1.log"
Jun 02 02:01:04.043709 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:04.043684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmlp4_b0da028a-7900-4cd5-beaa-cf84f5895851/kube-rbac-proxy/0.log"
Jun 02 02:01:04.069713 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:04.069692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmlp4_b0da028a-7900-4cd5-beaa-cf84f5895851/exporter/0.log"
Jun 02 02:01:04.096461 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:04.096439    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmlp4_b0da028a-7900-4cd5-beaa-cf84f5895851/extractor/0.log"
Jun 02 02:01:06.141362 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:06.141331    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-ds59b"
Jun 02 02:01:06.300183 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:06.300155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f9c748996-gk4wp_441cc249-25e2-4139-b7a7-07694d6b7415/nginx/0.log"
Jun 02 02:01:06.537067 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:06.537037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6_75a2d504-efc1-44bb-8919-f29eb76e9357/manager/0.log"
Jun 02 02:01:06.563707 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:06.563683    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-9s6d6_75a2d504-efc1-44bb-8919-f29eb76e9357/copy-manifests/0.log"
Jun 02 02:01:08.408952 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:08.408910    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74db8bbd6d-2rjwr_39a4e288-bf5c-454b-9f5c-6adbd389ff10/manager/0.log"
Jun 02 02:01:13.485404 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:13.485370    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-dc2x8_dbbc1644-e11a-4501-a0ec-1692290bacb9/migrator/0.log"
Jun 02 02:01:13.518962 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:13.518933    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-dc2x8_dbbc1644-e11a-4501-a0ec-1692290bacb9/graceful-termination/0.log"
Jun 02 02:01:15.446423 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.446393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/kube-multus-additional-cni-plugins/0.log"
Jun 02 02:01:15.476421 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.476398    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/egress-router-binary-copy/0.log"
Jun 02 02:01:15.504832 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.504809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/cni-plugins/0.log"
Jun 02 02:01:15.530539 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.530493    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/bond-cni-plugin/0.log"
Jun 02 02:01:15.556243 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.556225    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/routeoverride-cni/0.log"
Jun 02 02:01:15.582685 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.582655    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/whereabouts-cni-bincopy/0.log"
Jun 02 02:01:15.607406 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.607388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zzbhj_0b228450-b6c0-44b8-945d-b44fc950d2e9/whereabouts-cni/0.log"
Jun 02 02:01:15.644127 ip-10-0-129-109 kubenswrapper[2562]: I0602 02:01:15.644106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gnff6_9afe13f7-a2e7-4391-ad82-4521bde541ed/kube-multus/0.log"