Jun 03 08:41:31.537463 ip-10-0-129-83 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 08:41:31.537478 ip-10-0-129-83 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 08:41:31.537488 ip-10-0-129-83 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 08:41:31.537815 ip-10-0-129-83 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 08:41:41.566480 ip-10-0-129-83 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 08:41:41.566497 ip-10-0-129-83 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 83df668072d442958df4df1860827209 --
Jun 03 08:43:57.852203 ip-10-0-129-83 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 08:43:58.275447 ip-10-0-129-83 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 08:43:58.275447 ip-10-0-129-83 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 08:43:58.275447 ip-10-0-129-83 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 08:43:58.275447 ip-10-0-129-83 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 08:43:58.275447 ip-10-0-129-83 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 08:43:58.277654 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.277570    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282795    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282816    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282822    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282825    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282828    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282831    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282834    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 08:43:58.282824 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282837    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282840    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282843    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282846    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282849    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282852    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282868    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282871    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282874    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282876    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282879    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282882    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282884    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282887    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282890    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282893    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282905    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282908    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282911    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 08:43:58.283142 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282913    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282917    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282921    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282924    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282926    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282929    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282932    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282935    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282938    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282940    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282943    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282945    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282948    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282950    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282953    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282956    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282960    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282962    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282967    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282972    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 08:43:58.283609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282975    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282978    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282981    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282984    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282987    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282990    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282992    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282995    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.282999    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283002    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283004    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283007    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283011    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283013    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283016    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283019    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283022    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283025    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283028    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283030    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 08:43:58.284160 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283033    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283035    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283038    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283041    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283043    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283046    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283048    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283052    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283055    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283057    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283060    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283063    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283067    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283070    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283072    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283075    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283077    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283080    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283082    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283085    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 08:43:58.284642 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283514    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283520    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283523    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283526    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283528    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283531    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283534    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283536    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283539    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283541    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283544    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283547    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283549    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283552    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283555    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283557    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283560    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283562    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283565    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283568    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 08:43:58.285156 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283572    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283574    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283577    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283580    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283583    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283585    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283588    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283590    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283593    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283595    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283598    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283600    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283603    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283607    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283611    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283614    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283617    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283620    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283623    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283626    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 08:43:58.285640 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283628    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283631    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283633    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283636    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283638    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283641    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283643    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283646    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283648    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283651    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283653    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283656    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283660    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283662    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283665    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283668    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283693    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283697    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283700    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283704    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 08:43:58.286154 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283707    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283709    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283712    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283715    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283718    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283720    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283723    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283726    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283728    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283730    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283734    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283737    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283739    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283741    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283744    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283746    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283749    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283753    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283756    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 08:43:58.286648 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283759    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283761    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283763    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283766    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283770    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283773    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.283775    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285045    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285055    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285061    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285066    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285073    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285076    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285081    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285086    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285089    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285092    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285096    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285099    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285102    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285105    2575 flags.go:64] FLAG: --cgroup-root=""
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285108    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285111    2575 flags.go:64] FLAG: --client-ca-file=""
Jun 03 08:43:58.287139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285114    2575 flags.go:64] FLAG: --cloud-config=""
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285117    2575 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285120    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285124    2575 flags.go:64] FLAG: --cluster-domain=""
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285127    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285130    2575 flags.go:64] FLAG: --config-dir=""
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285133    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285136    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285140    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285143    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285146    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285150    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285154    2575 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285157    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285161    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285164    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285167    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285172    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285175    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285178    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285181    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285185    2575 flags.go:64] FLAG: --enable-server="true"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285188    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285192    2575 flags.go:64] FLAG: --event-burst="100"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285195    2575 flags.go:64] FLAG: --event-qps="50"
Jun 03 08:43:58.287696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285198    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285201    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285204    2575 flags.go:64] FLAG: --eviction-hard=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285208    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285211    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285214    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285217    2575 flags.go:64] FLAG: --eviction-soft=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285220    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285222    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285225    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285228    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285232    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285235    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285238    2575 flags.go:64] FLAG: --feature-gates=""
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285242    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285246    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285248    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285252    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285255    2575 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285259    2575 flags.go:64] FLAG: --help="false"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285263    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285266    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285270    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 08:43:58.288326 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285273    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285276    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285280    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285283    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285286    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285289    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285293    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285296    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285299    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285302    2575 flags.go:64] FLAG: --kube-reserved=""
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285305    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285308    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285311    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285314    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285317    2575 flags.go:64] FLAG: --lock-file=""
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285320    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285323    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285326    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285331    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285334    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285337    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285340    2575 flags.go:64] FLAG: --logging-format="text"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285343    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285346    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 08:43:58.288949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285349    2575 flags.go:64] FLAG: --manifest-url=""
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285352    2575 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285356    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285359    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285369    2575 flags.go:64] FLAG: --max-pods="110"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285372    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285375    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285378    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285381    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285385    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285388    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285391    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285398    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285401    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285405    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285409    2575 flags.go:64] FLAG: --pod-cidr=""
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285412    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285417    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285420    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285423    2575 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285426    2575 flags.go:64] FLAG: --port="10250"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285429    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285433    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa85a91d46db60db"
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285436    2575 flags.go:64] FLAG: --qos-reserved=""
Jun 03 08:43:58.289531 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285439    2575 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285442    2575 flags.go:64] FLAG: --register-node="true"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285445    2575 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285448    2575 flags.go:64] FLAG: --register-with-taints=""
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285452    2575 flags.go:64] FLAG: --registry-burst="10"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285454    2575 flags.go:64] FLAG: --registry-qps="5"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285457    2575 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285460    2575 flags.go:64] FLAG: --reserved-memory=""
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285464    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285467    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285470    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285472    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285476    2575 flags.go:64] FLAG: --runonce="false"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285479    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285483    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285486    2575 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285488    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285491    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285495    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285498    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285501    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285504    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285507    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285510    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285513    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285517    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 08:43:58.290129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285520    2575 flags.go:64] FLAG: --system-cgroups=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285522    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285527    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285530    2575 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285533    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285538    2575 flags.go:64] FLAG: --tls-min-version=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285541    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285543    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285546    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285549    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285552    2575 flags.go:64] FLAG: --v="2"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285556    2575 flags.go:64] FLAG: --version="false"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285560    2575 flags.go:64] FLAG: --vmodule=""
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285565    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285568    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285662    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285666    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285669    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285672    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285674    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285677    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285680    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285683    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 08:43:58.290749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285686    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285688    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285691    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285693    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285696    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285699    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285702    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285704    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285710    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285712    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285715    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285719    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285722    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285725    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285727    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285730    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285733    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285736    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285738    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285741    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 08:43:58.291483 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285743    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285746    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285749    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285751    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285754    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285756    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285759    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285761    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285764    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285767    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285769    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285772    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285774    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285777    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285779    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285782    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285784    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285787    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285790    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 08:43:58.292259 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285793    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285796    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285799    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285802    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285804    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285807    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285809    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285812    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285814    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285816    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285819    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285821    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285824    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285827    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285830    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285832    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285835    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285839    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285842    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 08:43:58.292775 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285845    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285848    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285851    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285853    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285868    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285871    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285873    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285876    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285879    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285882    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285884    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285887    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285890    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285892    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285895    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285898    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285901    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285904    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285906    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 08:43:58.293560 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.285909    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.285914    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.294019    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.294043    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294114    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294123    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294129    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294134    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294139    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294143    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294148    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294152    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294157    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294161    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294166    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294170    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 08:43:58.294399 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294174    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294178    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294182    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294187    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294191    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294195    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294199    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294204    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294208    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294212    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294216    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294220    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294224    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294228    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294233    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294237    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294241    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294246    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294250    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294256    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 08:43:58.295155 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294260    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294265    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294269    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294273    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294278    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294283    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294288    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294293    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294297    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294301    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294305    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294309    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294313    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294318    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294322    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294326    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294331    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294335    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294339    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 08:43:58.295701 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294344    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294348    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294352    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294356    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294360    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294364    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294369    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294373    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294377    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294382    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294386    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294390    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294394    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294400    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294404    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294408    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294412    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294416    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294420    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 08:43:58.296262 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294424    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294429    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294433    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294437    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294444    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294450    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294455    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294460    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294464    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294469    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294473    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294478    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294482    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294488    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294493    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 08:43:58.296939 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294498    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.294506    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294664    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294672    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294676    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294681    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294686    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294690    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294695    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294700    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294704    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294708    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294714    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294718    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294722    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 08:43:58.297350 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294726    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294730    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294735    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294739    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294743    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294747    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294751    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294756    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294760    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294764    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294768    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294772    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294776    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294780    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294785    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294788    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294793    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294798    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294802    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294806    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 08:43:58.297765 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294810    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294814    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294818    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294823    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294827    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294831    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294835    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294840    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294844    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294848    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294875    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294880    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294884    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294888    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294892    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294896    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294900    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294904    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294908    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294912    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 08:43:58.298319 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294917    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294921    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294925    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294929    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294934    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294938    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294942    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294946    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294950    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294954    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294958    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294963    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294967    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294971    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294975    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294979    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294983    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294987    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294991    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 08:43:58.298922 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.294996    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295003    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295009    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295014    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295020    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295025    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295029    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295033    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295037    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295042    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295047    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295051    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295057    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:58.295061    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.295069    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 08:43:58.299721 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.295888    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 08:43:58.301522 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.301504    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 08:43:58.302347 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.302334    2575 server.go:1019] "Starting client certificate rotation"
Jun 03 08:43:58.302456 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.302436    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 08:43:58.302491 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.302476    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 08:43:58.328115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.328090    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 08:43:58.333192 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.333170    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 08:43:58.347250 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.347227    2575 log.go:25] "Validated CRI v1 runtime API"
Jun 03 08:43:58.352473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.352457    2575 log.go:25] "Validated CRI v1 image API"
Jun 03 08:43:58.353648 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.353630    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 08:43:58.358368 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.358349    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e1abb3f2-45c4-4c31-92ce-d5b21121ae10:/dev/nvme0n1p4 f388b547-ca0d-42a9-b6a6-ef4db6887b8f:/dev/nvme0n1p3]
Jun 03 08:43:58.358481 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.358368    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 08:43:58.360217 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.360198    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 08:43:58.362937 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.362820    2575 manager.go:217] Machine: {Timestamp:2026-06-03 08:43:58.362303144 +0000 UTC m=+0.395307311 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3231194 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2045426fcde3724b0ce01c3d7d8b55 SystemUUID:ec204542-6fcd-e372-4b0c-e01c3d7d8b55 BootID:83df6680-72d4-4295-8df4-df1860827209 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:9a:cc:65:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:9a:cc:65:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:73:45:3f:fb:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 08:43:58.363665 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.363654    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 08:43:58.363760 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.363733    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 08:43:58.365401 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.365375    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 08:43:58.365540 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.365404    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 08:43:58.365589 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.365550    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 08:43:58.365589 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.365559    2575 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 08:43:58.365589 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.365566    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 08:43:58.366402 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.366392    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 08:43:58.368002 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.367991    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 08:43:58.368100 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.368092    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 08:43:58.370382 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.370372    2575 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 08:43:58.370424 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.370388    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 08:43:58.370424 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.370401    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 08:43:58.370424 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.370410    2575 kubelet.go:397] "Adding apiserver pod source"
Jun 03 08:43:58.370424 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.370419    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 08:43:58.371368 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.371353    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 08:43:58.371419 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.371390    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 08:43:58.374379 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.374362    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 08:43:58.376331 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.376317    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 08:43:58.378088 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.378071    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2qxq"
Jun 03 08:43:58.378989 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.378976    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.378995    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379002    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379008    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379017    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379023    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379029    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379035    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 08:43:58.379037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379042    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 08:43:58.379259 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379048    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 08:43:58.379259 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379057    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 08:43:58.379259 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379062    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 08:43:58.379888 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379877    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 08:43:58.379921 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.379890    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 08:43:58.383277 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.383264    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 08:43:58.383342 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.383314    2575 server.go:1295] "Started kubelet"
Jun 03 08:43:58.383397 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.383369    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 08:43:58.384506 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.384444    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 08:43:58.384635 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.384523    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 08:43:58.384694 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.384671    2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 08:43:58.384881 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.384838    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 08:43:58.384979 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.384953    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 08:43:58.385604 ip-10-0-129-83 systemd[1]: Started Kubernetes Kubelet.
Jun 03 08:43:58.385972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.385948    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 08:43:58.387025 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.386790    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2qxq"
Jun 03 08:43:58.387745 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.387714    2575 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 08:43:58.390299 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.389392    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-83.ec2.internal.18b585b497dbe04b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-83.ec2.internal,UID:ip-10-0-129-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-83.ec2.internal,},FirstTimestamp:2026-06-03 08:43:58.383276107 +0000 UTC m=+0.416280254,LastTimestamp:2026-06-03 08:43:58.383276107 +0000 UTC m=+0.416280254,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-83.ec2.internal,}"
Jun 03 08:43:58.392345 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.392329    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 08:43:58.392345 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.392336    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 08:43:58.392483 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.392377    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 08:43:58.392483 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.392385    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 08:43:58.392807 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.392787    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 08:43:58.393135 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393114    2575 factory.go:55] Registering systemd factory
Jun 03 08:43:58.393209 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393138    2575 factory.go:223] Registration of the systemd container factory successfully
Jun 03 08:43:58.393209 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393141    2575 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 08:43:58.393209 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393152    2575 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 08:43:58.393310 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.393263    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.393874 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393835    2575 factory.go:153] Registering CRI-O factory
Jun 03 08:43:58.393874 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393869    2575 factory.go:223] Registration of the crio container factory successfully
Jun 03 08:43:58.394013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393921    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 08:43:58.394013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393940    2575 factory.go:103] Registering Raw factory
Jun 03 08:43:58.394013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.393955    2575 manager.go:1196] Started watching for new ooms in manager
Jun 03 08:43:58.396099 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.394496    2575 manager.go:319] Starting recovery of all containers
Jun 03 08:43:58.396354 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.396331    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:43:58.398744 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.398722    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-83.ec2.internal\" not found" node="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.405428 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.405277    2575 manager.go:324] Recovery completed
Jun 03 08:43:58.410121 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.410108    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.412396 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412379    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.412464 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412410    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.412464 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412421    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.412883 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412847    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 08:43:58.412883 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412880    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 08:43:58.412989 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.412896    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 08:43:58.415302 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.415290    2575 policy_none.go:49] "None policy: Start"
Jun 03 08:43:58.415354 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.415315    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 08:43:58.415354 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.415327    2575 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 08:43:58.450473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450458    2575 manager.go:341] "Starting Device Plugin manager"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.450498    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450512    2575 server.go:85] "Starting device plugin registration server"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450815    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450829    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450914    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.450999    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.451010    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.451537    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 08:43:58.467406 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.451568    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.486770 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.486729    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 08:43:58.488173 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.488152    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 08:43:58.488173 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.488176    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 08:43:58.488333 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.488194    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 08:43:58.488333 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.488200    2575 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 08:43:58.488333 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.488240    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 08:43:58.492068 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.492050    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:43:58.551251 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.551182    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.552150 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.552130    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.552263 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.552160    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.552263 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.552171    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.552263 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.552194    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.560293 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.560274    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.560397 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.560297    2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-83.ec2.internal\": node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.585714 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.585694    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.588868 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.588829    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"]
Jun 03 08:43:58.588964 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.588906    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.589682 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.589662    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.589736 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.589695    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.589736 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.589706    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.590940 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.590928    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.591075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591062    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.591121 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591090    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.591641 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591625    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.591730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591652    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.591730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591631    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.591730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591681    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.591730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591691    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.591730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.591661    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.592921 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.592907    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.593008 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.592931    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 08:43:58.593593 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.593578    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 08:43:58.593679 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.593607    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 08:43:58.593679 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.593620    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeHasSufficientPID"
Jun 03 08:43:58.594728 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.594710    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0de778e07c4a737a6827196a122b0f05-config\") pod \"kube-apiserver-proxy-ip-10-0-129-83.ec2.internal\" (UID: \"0de778e07c4a737a6827196a122b0f05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.594814 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.594744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.594814 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.594771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.628767 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.628741    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-83.ec2.internal\" not found" node="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.633371 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.633358    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-83.ec2.internal\" not found" node="ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.686677 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.686650    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.695033 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695009    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0de778e07c4a737a6827196a122b0f05-config\") pod \"kube-apiserver-proxy-ip-10-0-129-83.ec2.internal\" (UID: \"0de778e07c4a737a6827196a122b0f05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.695165 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.695165 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695056    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.695165 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695106    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.695165 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695115    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0de778e07c4a737a6827196a122b0f05-config\") pod \"kube-apiserver-proxy-ip-10-0-129-83.ec2.internal\" (UID: \"0de778e07c4a737a6827196a122b0f05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.695165 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.695114    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06f33d0cb79368605600ed4df35ee6f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal\" (UID: \"06f33d0cb79368605600ed4df35ee6f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.787397 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.787352    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.888179 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.888107    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:58.931581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.931548    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.937194 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:58.937176    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:58.988885 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:58.988839    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.089331 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:59.089305    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.189907 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:59.189803    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.290337 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:59.290292    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.302743 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.302721    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 08:43:59.302928 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.302895    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 08:43:59.302928 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.302917    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 08:43:59.390122 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.390083    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 08:38:58 +0000 UTC" deadline="2028-01-21 17:52:36.71317339 +0000 UTC"
Jun 03 08:43:59.390122 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.390114    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14337h8m37.323062534s"
Jun 03 08:43:59.391171 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:59.391153    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.392408 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.392393    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 08:43:59.404339 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.404318    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 08:43:59.428922 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.428895    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqkb6"
Jun 03 08:43:59.429966 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:59.429931    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de778e07c4a737a6827196a122b0f05.slice/crio-629529ba2f1d6c29f13041c1b700a899061596414a9243fb778ae9079aa80f1c WatchSource:0}: Error finding container 629529ba2f1d6c29f13041c1b700a899061596414a9243fb778ae9079aa80f1c: Status 404 returned error can't find the container with id 629529ba2f1d6c29f13041c1b700a899061596414a9243fb778ae9079aa80f1c
Jun 03 08:43:59.430130 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:43:59.430116    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f33d0cb79368605600ed4df35ee6f2.slice/crio-f04049227d6ef49af35f02f202ed7c1a0a0af92e0be6f07182041b8a9a7c07d4 WatchSource:0}: Error finding container f04049227d6ef49af35f02f202ed7c1a0a0af92e0be6f07182041b8a9a7c07d4: Status 404 returned error can't find the container with id f04049227d6ef49af35f02f202ed7c1a0a0af92e0be6f07182041b8a9a7c07d4
Jun 03 08:43:59.435650 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.434778    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqkb6"
Jun 03 08:43:59.435962 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.435944    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 08:43:59.490762 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.490670    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal" event={"ID":"0de778e07c4a737a6827196a122b0f05","Type":"ContainerStarted","Data":"629529ba2f1d6c29f13041c1b700a899061596414a9243fb778ae9079aa80f1c"}
Jun 03 08:43:59.491207 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:43:59.491193    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-83.ec2.internal\" not found"
Jun 03 08:43:59.491538 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.491517    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal" event={"ID":"06f33d0cb79368605600ed4df35ee6f2","Type":"ContainerStarted","Data":"f04049227d6ef49af35f02f202ed7c1a0a0af92e0be6f07182041b8a9a7c07d4"}
Jun 03 08:43:59.576521 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.576489    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:43:59.593284 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.593259    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:59.605462 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.605444    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 08:43:59.606896 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.606881    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal"
Jun 03 08:43:59.615926 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.615905    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 08:43:59.709884 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:43:59.709124    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:44:00.372038 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.372007    2575 apiserver.go:52] "Watching apiserver"
Jun 03 08:44:00.378175 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.378154    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 08:44:00.378553 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.378525    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp","openshift-image-registry/node-ca-twc8b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal","openshift-multus/multus-additional-cni-plugins-5b6ws","openshift-multus/network-metrics-daemon-2vgxx","openshift-network-diagnostics/network-check-target-pfq86","kube-system/konnectivity-agent-4d259","kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l27b8","openshift-multus/multus-7j2zm","openshift-network-operator/iptables-alerter-92hlr","openshift-ovn-kubernetes/ovnkube-node-qwmxm"]
Jun 03 08:44:00.380226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.380205    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.381310 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.381294    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.382638 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.382616    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nxm65\""
Jun 03 08:44:00.383092 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.383065    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.383183 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.383140    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.383338 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.383319    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 08:44:00.384457 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.383918    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.384457 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.383973    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 08:44:00.384457 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.384121    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.384457 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.384205    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8vs97\""
Jun 03 08:44:00.384696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.384561    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.385621 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.385475    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.385621 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.385562    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:00.385775 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.385630    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:00.385775 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.385557    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:00.385775 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.385767    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 08:44:00.385955 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.385850    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.386215 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.386069    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.386215 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.386122    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 08:44:00.386215 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.386155    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 08:44:00.386399 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.386370    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-69j89\""
Jun 03 08:44:00.386923 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.386903    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.388301 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.388281    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.388755 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.388611    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 08:44:00.388755 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.388648    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2pfc\""
Jun 03 08:44:00.388755 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.388734    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 08:44:00.389721 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.389528    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.390185 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.390004    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dqxtx\""
Jun 03 08:44:00.390185 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.390035    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.390457 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.390429    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.391059 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.391040    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.391664 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.391640    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 08:44:00.392099 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.392076    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9gbck\""
Jun 03 08:44:00.393630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.393381    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 08:44:00.393718 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.393629    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smxbr\""
Jun 03 08:44:00.394720 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.393943    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.394720 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.394283    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.394720 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.394633    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.397455 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.397023    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 08:44:00.397545 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.397486    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 08:44:00.397545 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.397516    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 08:44:00.398136 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.398008    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 08:44:00.398136 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.398071    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 08:44:00.398271 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.398253    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 08:44:00.398405 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.398382    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wgxqz\""
Jun 03 08:44:00.404877 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.404837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.404963 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.404890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-sys-fs\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.404963 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.404919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.404963 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.404947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-netns\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.404975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-kubelet\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61adc58a-6601-40ea-8a45-80aae27478ce-ovn-node-metrics-cert\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-var-lib-kubelet\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38ac16e4-5309-402e-98c3-d5dc027a90f1-serviceca\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f590e96a-df80-428f-ac8d-5be5aa894931-host-slash\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-ovn\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.405132 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1619303c-d8ae-475f-bd0b-dbc8fba9d254-konnectivity-ca\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-systemd\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-system-cni-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cnibin\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-system-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-etc-kubernetes\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-host\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-conf-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-log-socket\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-os-release\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysconfig\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.405435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-os-release\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-var-lib-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chhp8\" (UniqueName: \"kubernetes.io/projected/38ac16e4-5309-402e-98c3-d5dc027a90f1-kube-api-access-chhp8\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-hostroot\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9v6\" (UniqueName: \"kubernetes.io/projected/0cd087ea-c233-45e2-8060-54ace9000fa9-kube-api-access-th9v6\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-systemd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-modprobe-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-kubernetes\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-conf\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-cnibin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-tmp\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-daemon-config\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w767\" (UniqueName: \"kubernetes.io/projected/f590e96a-df80-428f-ac8d-5be5aa894931-kube-api-access-6w767\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.406115 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-slash\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9ss\" (UniqueName: \"kubernetes.io/projected/61adc58a-6601-40ea-8a45-80aae27478ce-kube-api-access-jr9ss\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-socket-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-etc-tuned\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-multus-certs\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-bin\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1619303c-d8ae-475f-bd0b-dbc8fba9d254-agent-certs\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.405996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-lib-modules\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-netns\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-etc-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-node-log\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-netd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-device-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-multus\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.406957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-socket-dir-parent\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f590e96a-df80-428f-ac8d-5be5aa894931-iptables-alerter-script\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-run\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-env-overrides\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-cni-binary-copy\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-script-lib\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-sys\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38ac16e4-5309-402e-98c3-d5dc027a90f1-host\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-bin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-config\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-registration-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbl7\" (UniqueName: \"kubernetes.io/projected/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-kube-api-access-9dbl7\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85j2q\" (UniqueName: \"kubernetes.io/projected/f36790f3-4d28-47a1-a953-260259281e93-kube-api-access-85j2q\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-k8s-cni-cncf-io\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.407725 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79nw\" (UniqueName: \"kubernetes.io/projected/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kube-api-access-n79nw\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.408510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9d9m\" (UniqueName: \"kubernetes.io/projected/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-kube-api-access-k9d9m\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.408510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-kubelet\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.408510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-systemd-units\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.408510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.406815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.435563 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.435537    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:38:59 +0000 UTC" deadline="2027-11-11 13:56:41.539774819 +0000 UTC"
Jun 03 08:44:00.435563 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.435562    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12629h12m41.104214939s"
Jun 03 08:44:00.494504 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.494083    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 08:44:00.507452 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507419    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-modprobe-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507462    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-kubernetes\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-conf\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507507    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-cnibin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507529    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507581    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-kubernetes\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507596    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-cnibin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.507613 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507602    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-modprobe-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507633    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507666    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-tmp\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507666    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-conf\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507686    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-daemon-config\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507727    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w767\" (UniqueName: \"kubernetes.io/projected/f590e96a-df80-428f-ac8d-5be5aa894931-kube-api-access-6w767\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507758    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-slash\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507781    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9ss\" (UniqueName: \"kubernetes.io/projected/61adc58a-6601-40ea-8a45-80aae27478ce-kube-api-access-jr9ss\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507806    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-socket-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507828    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-etc-tuned\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507850    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-multus-certs\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507891    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-bin\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507915    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1619303c-d8ae-475f-bd0b-dbc8fba9d254-agent-certs\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507938    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-lib-modules\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507963    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:00.507978 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.507987    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-netns\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508013    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-etc-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508037    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-node-log\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508046    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508070    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-netd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508111    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508120    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-device-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508146    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-multus\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508172    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-slash\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508196    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-socket-dir-parent\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508222    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f590e96a-df80-428f-ac8d-5be5aa894931-iptables-alerter-script\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-run\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508271    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-env-overrides\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508295    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-cni-binary-copy\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508318    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-script-lib\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508352    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508375    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-sys\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.508647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508398    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38ac16e4-5309-402e-98c3-d5dc027a90f1-host\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508425    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-bin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508451    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-config\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-multus\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508482    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-registration-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508503    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-multus-certs\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508511    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbl7\" (UniqueName: \"kubernetes.io/projected/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-kube-api-access-9dbl7\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508543    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-bin\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508564    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85j2q\" (UniqueName: \"kubernetes.io/projected/f36790f3-4d28-47a1-a953-260259281e93-kube-api-access-85j2q\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508591    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-k8s-cni-cncf-io\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508618    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79nw\" (UniqueName: \"kubernetes.io/projected/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kube-api-access-n79nw\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508647    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9d9m\" (UniqueName: \"kubernetes.io/projected/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-kube-api-access-k9d9m\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508651    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-daemon-config\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508675    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-kubelet\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508708    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-systemd-units\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508733    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.509487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508754    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-socket-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508760    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508776    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38ac16e4-5309-402e-98c3-d5dc027a90f1-host\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508786    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-sys-fs\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-run\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508841    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-netns\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508886    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-kubelet\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508910    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61adc58a-6601-40ea-8a45-80aae27478ce-ovn-node-metrics-cert\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508935    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-var-lib-kubelet\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508937    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-etc-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508961    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38ac16e4-5309-402e-98c3-d5dc027a90f1-serviceca\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508988    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f590e96a-df80-428f-ac8d-5be5aa894931-host-slash\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509012    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-ovn\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509042    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1619303c-d8ae-475f-bd0b-dbc8fba9d254-konnectivity-ca\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509093    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-systemd\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509120    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-system-cni-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.510287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509169    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cnibin\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509197    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509213    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-env-overrides\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509224    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-system-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509251    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-etc-kubernetes\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-netns\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.508194    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509297    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cd087ea-c233-45e2-8060-54ace9000fa9-cni-binary-copy\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509326    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-host\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509332    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-socket-dir-parent\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509351    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-conf-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509379    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-log-socket\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-sys\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509407    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.509413    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:00.511074 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509432    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-os-release\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.509487    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:01.009464446 +0000 UTC m=+3.042468585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysconfig\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509527    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-os-release\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509536    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysconfig\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509582    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-var-lib-kubelet\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-var-lib-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509620    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-var-lib-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509626    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chhp8\" (UniqueName: \"kubernetes.io/projected/38ac16e4-5309-402e-98c3-d5dc027a90f1-kube-api-access-chhp8\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-hostroot\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509681    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th9v6\" (UniqueName: \"kubernetes.io/projected/0cd087ea-c233-45e2-8060-54ace9000fa9-kube-api-access-th9v6\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509708    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-systemd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509735    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509773    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f590e96a-df80-428f-ac8d-5be5aa894931-iptables-alerter-script\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509784    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-etc-kubernetes\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509050    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-lib-modules\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-host\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.511830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509851    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f590e96a-df80-428f-ac8d-5be5aa894931-host-slash\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-systemd\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509886    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-os-release\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509931    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-os-release\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509932    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.509981    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cnibin\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510338    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38ac16e4-5309-402e-98c3-d5dc027a90f1-serviceca\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510391    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-system-cni-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510395    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1619303c-d8ae-475f-bd0b-dbc8fba9d254-konnectivity-ca\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510426    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-script-lib\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-hostroot\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510481    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-openvswitch\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-log-socket\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510546    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-system-cni-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-multus-conf-dir\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510607    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-systemd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510621    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.512642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-k8s-cni-cncf-io\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510714    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-kubelet\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510758    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-systemd-units\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510803    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510837    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-run-ovn\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510842    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-registration-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510891    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-cni-bin\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510926    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-host-cni-netd\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510962    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61adc58a-6601-40ea-8a45-80aae27478ce-node-log\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.510803    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-device-dir\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511003    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36790f3-4d28-47a1-a953-260259281e93-etc-sysctl-d\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d8df654-e9b2-43e7-8d06-46f45549b5b6-sys-fs\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511030    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-var-lib-kubelet\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cd087ea-c233-45e2-8060-54ace9000fa9-host-run-netns\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511107    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61adc58a-6601-40ea-8a45-80aae27478ce-ovnkube-config\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511721    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-etc-tuned\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.513280 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.511792    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36790f3-4d28-47a1-a953-260259281e93-tmp\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.513763 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.512779    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1619303c-d8ae-475f-bd0b-dbc8fba9d254-agent-certs\") pod \"konnectivity-agent-4d259\" (UID: \"1619303c-d8ae-475f-bd0b-dbc8fba9d254\") " pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.513763 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.513108    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61adc58a-6601-40ea-8a45-80aae27478ce-ovn-node-metrics-cert\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.518586 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.518564    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:00.518586 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.518589    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:00.518729 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.518603    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:00.518729 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:00.518678    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:01.01865762 +0000 UTC m=+3.051661757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:00.518823 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.518786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w767\" (UniqueName: \"kubernetes.io/projected/f590e96a-df80-428f-ac8d-5be5aa894931-kube-api-access-6w767\") pod \"iptables-alerter-92hlr\" (UID: \"f590e96a-df80-428f-ac8d-5be5aa894931\") " pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.520832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.520797    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9d9m\" (UniqueName: \"kubernetes.io/projected/2b5b960c-20ac-4652-bd3d-6cac49b2a58a-kube-api-access-k9d9m\") pod \"multus-additional-cni-plugins-5b6ws\" (UID: \"2b5b960c-20ac-4652-bd3d-6cac49b2a58a\") " pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.522068 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.522033    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79nw\" (UniqueName: \"kubernetes.io/projected/2d8df654-e9b2-43e7-8d06-46f45549b5b6-kube-api-access-n79nw\") pod \"aws-ebs-csi-driver-node-btfbp\" (UID: \"2d8df654-e9b2-43e7-8d06-46f45549b5b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.522068 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.522041    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9v6\" (UniqueName: \"kubernetes.io/projected/0cd087ea-c233-45e2-8060-54ace9000fa9-kube-api-access-th9v6\") pod \"multus-7j2zm\" (UID: \"0cd087ea-c233-45e2-8060-54ace9000fa9\") " pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.522740 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.522701    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85j2q\" (UniqueName: \"kubernetes.io/projected/f36790f3-4d28-47a1-a953-260259281e93-kube-api-access-85j2q\") pod \"tuned-l27b8\" (UID: \"f36790f3-4d28-47a1-a953-260259281e93\") " pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.523211 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.523176    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9ss\" (UniqueName: \"kubernetes.io/projected/61adc58a-6601-40ea-8a45-80aae27478ce-kube-api-access-jr9ss\") pod \"ovnkube-node-qwmxm\" (UID: \"61adc58a-6601-40ea-8a45-80aae27478ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.523360 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.523253    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chhp8\" (UniqueName: \"kubernetes.io/projected/38ac16e4-5309-402e-98c3-d5dc027a90f1-kube-api-access-chhp8\") pod \"node-ca-twc8b\" (UID: \"38ac16e4-5309-402e-98c3-d5dc027a90f1\") " pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.523671 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.523646    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbl7\" (UniqueName: \"kubernetes.io/projected/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-kube-api-access-9dbl7\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:00.692977 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.692881    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp"
Jun 03 08:44:00.701876 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.701836    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twc8b"
Jun 03 08:44:00.709566 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.709537    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5b6ws"
Jun 03 08:44:00.713722 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.713702    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:00.719278 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.719256    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l27b8"
Jun 03 08:44:00.725915 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.725892    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j2zm"
Jun 03 08:44:00.733444 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.733426    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-92hlr"
Jun 03 08:44:00.738091 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.738070    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:00.751819 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.751790    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:44:00.782080 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:00.782046    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 08:44:00.931877 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.931834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36790f3_4d28_47a1_a953_260259281e93.slice/crio-64e51c812cbf8f3a3a5ee850b2c3a09556d56576aaed0527219517042cebda04 WatchSource:0}: Error finding container 64e51c812cbf8f3a3a5ee850b2c3a09556d56576aaed0527219517042cebda04: Status 404 returned error can't find the container with id 64e51c812cbf8f3a3a5ee850b2c3a09556d56576aaed0527219517042cebda04
Jun 03 08:44:00.932753 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.932723    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ac16e4_5309_402e_98c3_d5dc027a90f1.slice/crio-86fda17e355995a2ce5604992aae43b96f46f585203ef12abf4451641749e92c WatchSource:0}: Error finding container 86fda17e355995a2ce5604992aae43b96f46f585203ef12abf4451641749e92c: Status 404 returned error can't find the container with id 86fda17e355995a2ce5604992aae43b96f46f585203ef12abf4451641749e92c
Jun 03 08:44:00.934412 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.934389    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1619303c_d8ae_475f_bd0b_dbc8fba9d254.slice/crio-08eec96a34fbab6ced81b3ab717f8968a89928423f4ac6d7872a5f0aa8901fff WatchSource:0}: Error finding container 08eec96a34fbab6ced81b3ab717f8968a89928423f4ac6d7872a5f0aa8901fff: Status 404 returned error can't find the container with id 08eec96a34fbab6ced81b3ab717f8968a89928423f4ac6d7872a5f0aa8901fff
Jun 03 08:44:00.935787 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.935574    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf590e96a_df80_428f_ac8d_5be5aa894931.slice/crio-2cf5d243011d5a1b997f796b930e8e47bf6fc1ddd420a673e7c316125c2a3242 WatchSource:0}: Error finding container 2cf5d243011d5a1b997f796b930e8e47bf6fc1ddd420a673e7c316125c2a3242: Status 404 returned error can't find the container with id 2cf5d243011d5a1b997f796b930e8e47bf6fc1ddd420a673e7c316125c2a3242
Jun 03 08:44:00.938202 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.938000    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5b960c_20ac_4652_bd3d_6cac49b2a58a.slice/crio-acf89c5f3c9a598b653fec619123e8dd536660cbe77e77aa3293ba725ed15104 WatchSource:0}: Error finding container acf89c5f3c9a598b653fec619123e8dd536660cbe77e77aa3293ba725ed15104: Status 404 returned error can't find the container with id acf89c5f3c9a598b653fec619123e8dd536660cbe77e77aa3293ba725ed15104
Jun 03 08:44:00.939441 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.939414    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61adc58a_6601_40ea_8a45_80aae27478ce.slice/crio-5fd780d77c94e40c324b54f2906a6cdda3419635691ec4fbb69bf81c6a2cfce5 WatchSource:0}: Error finding container 5fd780d77c94e40c324b54f2906a6cdda3419635691ec4fbb69bf81c6a2cfce5: Status 404 returned error can't find the container with id 5fd780d77c94e40c324b54f2906a6cdda3419635691ec4fbb69bf81c6a2cfce5
Jun 03 08:44:00.941813 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.941585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd087ea_c233_45e2_8060_54ace9000fa9.slice/crio-3067a9c946fc44783a741939c766e28053b464c912377fa32eafb087108f3819 WatchSource:0}: Error finding container 3067a9c946fc44783a741939c766e28053b464c912377fa32eafb087108f3819: Status 404 returned error can't find the container with id 3067a9c946fc44783a741939c766e28053b464c912377fa32eafb087108f3819
Jun 03 08:44:00.943381 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:00.943358    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8df654_e9b2_43e7_8d06_46f45549b5b6.slice/crio-737afbcb6720e7a0ac352bda6ceada0186731deb1688f6f21d8426dc7361d8ff WatchSource:0}: Error finding container 737afbcb6720e7a0ac352bda6ceada0186731deb1688f6f21d8426dc7361d8ff: Status 404 returned error can't find the container with id 737afbcb6720e7a0ac352bda6ceada0186731deb1688f6f21d8426dc7361d8ff
Jun 03 08:44:01.013517 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.013335    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:01.013636 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.013467    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:01.013636 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.013617    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:02.013599323 +0000 UTC m=+4.046603479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:01.114444 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.114411    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:01.114572 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.114557    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:01.114572 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.114573    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:01.114650 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.114582    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:01.114650 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:01.114635    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:02.11461979 +0000 UTC m=+4.147623947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:01.436662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.436617    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:38:59 +0000 UTC" deadline="2027-12-26 12:45:33.792140956 +0000 UTC"
Jun 03 08:44:01.436662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.436659    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13708h1m32.355485383s"
Jun 03 08:44:01.501455 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.501052    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal" event={"ID":"0de778e07c4a737a6827196a122b0f05","Type":"ContainerStarted","Data":"907f54141a070f39ee9605a58272b4e135d7f03650da81e28389135053190336"}
Jun 03 08:44:01.504697 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.504667    2575 generic.go:358] "Generic (PLEG): container finished" podID="06f33d0cb79368605600ed4df35ee6f2" containerID="aded8516e3f3176f474927f310b60d8c593ca5e7c8ed47d152a42e950d5ee560" exitCode=0
Jun 03 08:44:01.504818 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.504749    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal" event={"ID":"06f33d0cb79368605600ed4df35ee6f2","Type":"ContainerDied","Data":"aded8516e3f3176f474927f310b60d8c593ca5e7c8ed47d152a42e950d5ee560"}
Jun 03 08:44:01.507346 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.507269    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j2zm" event={"ID":"0cd087ea-c233-45e2-8060-54ace9000fa9","Type":"ContainerStarted","Data":"3067a9c946fc44783a741939c766e28053b464c912377fa32eafb087108f3819"}
Jun 03 08:44:01.511237 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.511214    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"5fd780d77c94e40c324b54f2906a6cdda3419635691ec4fbb69bf81c6a2cfce5"}
Jun 03 08:44:01.519334 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.519311    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4d259" event={"ID":"1619303c-d8ae-475f-bd0b-dbc8fba9d254","Type":"ContainerStarted","Data":"08eec96a34fbab6ced81b3ab717f8968a89928423f4ac6d7872a5f0aa8901fff"}
Jun 03 08:44:01.525622 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.525593    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twc8b" event={"ID":"38ac16e4-5309-402e-98c3-d5dc027a90f1","Type":"ContainerStarted","Data":"86fda17e355995a2ce5604992aae43b96f46f585203ef12abf4451641749e92c"}
Jun 03 08:44:01.526976 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.526930    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-83.ec2.internal" podStartSLOduration=2.526916488 podStartE2EDuration="2.526916488s" podCreationTimestamp="2026-06-03 08:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:44:01.51513159 +0000 UTC m=+3.548135748" watchObservedRunningTime="2026-06-03 08:44:01.526916488 +0000 UTC m=+3.559920645"
Jun 03 08:44:01.532152 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.532128    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l27b8" event={"ID":"f36790f3-4d28-47a1-a953-260259281e93","Type":"ContainerStarted","Data":"64e51c812cbf8f3a3a5ee850b2c3a09556d56576aaed0527219517042cebda04"}
Jun 03 08:44:01.536097 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.536071    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp" event={"ID":"2d8df654-e9b2-43e7-8d06-46f45549b5b6","Type":"ContainerStarted","Data":"737afbcb6720e7a0ac352bda6ceada0186731deb1688f6f21d8426dc7361d8ff"}
Jun 03 08:44:01.537665 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.537641    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerStarted","Data":"acf89c5f3c9a598b653fec619123e8dd536660cbe77e77aa3293ba725ed15104"}
Jun 03 08:44:01.545530 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:01.545502    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-92hlr" event={"ID":"f590e96a-df80-428f-ac8d-5be5aa894931","Type":"ContainerStarted","Data":"2cf5d243011d5a1b997f796b930e8e47bf6fc1ddd420a673e7c316125c2a3242"}
Jun 03 08:44:02.022346 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:02.022260    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:02.022532 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.022421    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:02.022532 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.022488    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:04.022468603 +0000 UTC m=+6.055472743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:02.123466 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:02.123417    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:02.123638 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.123600    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:02.123638 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.123618    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:02.123638 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.123631    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:02.123801 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.123688    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:04.123670816 +0000 UTC m=+6.156674955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:02.492316 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:02.491467    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:02.492316 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.491601    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:02.492316 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:02.492122    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:02.492316 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:02.492206    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:02.555966 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:02.555933    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal" event={"ID":"06f33d0cb79368605600ed4df35ee6f2","Type":"ContainerStarted","Data":"3102280092b07cd97d40b8395176f2d4a25735bdc6133410b5727597a0a79d31"}
Jun 03 08:44:04.042687 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:04.042638    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:04.043193 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.042785    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:04.043193 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.042848    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:08.04283046 +0000 UTC m=+10.075834600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:04.143620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:04.143572    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:04.143814 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.143792    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:04.143814 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.143809    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:04.143961 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.143823    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:04.143961 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.143903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:08.143883529 +0000 UTC m=+10.176887664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:04.489896 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:04.489793    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:04.489896 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:04.489793    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:04.490101 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.489959    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:04.491523 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:04.490316    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:06.489527 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:06.489087    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:06.489527 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:06.489135    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:06.489527 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:06.489209    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:06.489527 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:06.489429    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:08.077774 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:08.077737    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:08.078247 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.077907    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:08.078247 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.077987    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:16.077965264 +0000 UTC m=+18.110969434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:08.178821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:08.178709    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:08.179020 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.178936    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:08.179020 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.178958    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:08.179020 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.178971    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:08.179183 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.179038    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:16.179018676 +0000 UTC m=+18.212022827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:08.493631 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:08.493592    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:08.493782 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:08.493588    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:08.493782 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.493733    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:08.493947 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:08.493793    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:10.489385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:10.489350    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:10.489385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:10.489376    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:10.489780 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:10.489495    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:10.489780 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:10.489597    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:12.488982 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:12.488943    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:12.488982 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:12.488975    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:12.489526 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:12.489087    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:12.489526 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:12.489198    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:14.489168 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:14.489084    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:14.489577 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:14.489216    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:14.489577 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:14.489271    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:14.489577 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:14.489392    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:16.131038 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:16.130998    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:16.131476 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.131154    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:16.131476 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.131225    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:32.131206016 +0000 UTC m=+34.164210149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:16.231404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:16.231365    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:16.231586 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.231555    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:16.231586 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.231579    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:16.231692 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.231592    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:16.231692 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.231663    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:32.231642542 +0000 UTC m=+34.264646689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:16.488542 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:16.488451    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:16.488703 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:16.488466    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:16.488703 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.488576    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:16.488703 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:16.488682    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:18.489995 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:18.489960    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:18.490543 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:18.490080    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:18.490543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:18.490161    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:18.490543 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:18.490276    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:19.585407 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.585188    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j2zm" event={"ID":"0cd087ea-c233-45e2-8060-54ace9000fa9","Type":"ContainerStarted","Data":"f73612f09dbf7ea1ec8c4c5a918e8d7277f8e87c0ad66033d492a8d5181abaa0"}
Jun 03 08:44:19.586844 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.586817    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"a189e0b8316c0b8a214567c05bd9f1722b787566dcf3cb5e601a278f6f7786b4"}
Jun 03 08:44:19.586947 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.586868    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"5d93a34f6ea2f13e9dd389728d13f2a7b0f406e9ceee5f2e29c633cc93b83307"}
Jun 03 08:44:19.588013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.587977    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4d259" event={"ID":"1619303c-d8ae-475f-bd0b-dbc8fba9d254","Type":"ContainerStarted","Data":"0e40f5fe8344ef9d6ef9f4303c54fd473779bc1a4b72f40fb9144f5c7945b50a"}
Jun 03 08:44:19.589101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.589082    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twc8b" event={"ID":"38ac16e4-5309-402e-98c3-d5dc027a90f1","Type":"ContainerStarted","Data":"254e44b6ac6e7b1ccf261447bd6e470adde438875b7121e47181023ff48c610b"}
Jun 03 08:44:19.590239 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.590216    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l27b8" event={"ID":"f36790f3-4d28-47a1-a953-260259281e93","Type":"ContainerStarted","Data":"00bda802aaca998cd1f404ca14627938cf5af1642411a3f57e161517d3096ea6"}
Jun 03 08:44:19.591434 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.591416    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp" event={"ID":"2d8df654-e9b2-43e7-8d06-46f45549b5b6","Type":"ContainerStarted","Data":"1ea7964a87a4faff8e675a7b68ba78b3fdb38d2ced3cd357ff5188a5d136506e"}
Jun 03 08:44:19.592588 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.592570    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="548c5cd007bf269d18135fadd9c89984238ed534254915a67271f41fcba47014" exitCode=0
Jun 03 08:44:19.592671 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.592596    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"548c5cd007bf269d18135fadd9c89984238ed534254915a67271f41fcba47014"}
Jun 03 08:44:19.602749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.602707    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7j2zm" podStartSLOduration=3.5759121990000002 podStartE2EDuration="21.602696812s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.943758031 +0000 UTC m=+2.976762193" lastFinishedPulling="2026-06-03 08:44:18.970542673 +0000 UTC m=+21.003546806" observedRunningTime="2026-06-03 08:44:19.60268324 +0000 UTC m=+21.635687396" watchObservedRunningTime="2026-06-03 08:44:19.602696812 +0000 UTC m=+21.635700967"
Jun 03 08:44:19.603206 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.603176    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-83.ec2.internal" podStartSLOduration=20.60316805 podStartE2EDuration="20.60316805s" podCreationTimestamp="2026-06-03 08:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:44:02.569312664 +0000 UTC m=+4.602316821" watchObservedRunningTime="2026-06-03 08:44:19.60316805 +0000 UTC m=+21.636172207"
Jun 03 08:44:19.616436 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.616348    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-twc8b" podStartSLOduration=3.591778116 podStartE2EDuration="21.616306838s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.934673709 +0000 UTC m=+2.967677843" lastFinishedPulling="2026-06-03 08:44:18.95920243 +0000 UTC m=+20.992206565" observedRunningTime="2026-06-03 08:44:19.615055143 +0000 UTC m=+21.648059322" watchObservedRunningTime="2026-06-03 08:44:19.616306838 +0000 UTC m=+21.649310990"
Jun 03 08:44:19.643609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.643535    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l27b8" podStartSLOduration=3.6162603300000002 podStartE2EDuration="21.643518081s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.93350519 +0000 UTC m=+2.966509339" lastFinishedPulling="2026-06-03 08:44:18.96076295 +0000 UTC m=+20.993767090" observedRunningTime="2026-06-03 08:44:19.64277092 +0000 UTC m=+21.675775076" watchObservedRunningTime="2026-06-03 08:44:19.643518081 +0000 UTC m=+21.676522239"
Jun 03 08:44:19.681039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:19.680985    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4d259" podStartSLOduration=8.477505645 podStartE2EDuration="21.680966696s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.936580902 +0000 UTC m=+2.969585036" lastFinishedPulling="2026-06-03 08:44:14.140041952 +0000 UTC m=+16.173046087" observedRunningTime="2026-06-03 08:44:19.680806126 +0000 UTC m=+21.713810282" watchObservedRunningTime="2026-06-03 08:44:19.680966696 +0000 UTC m=+21.713970854"
Jun 03 08:44:20.369677 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.369472    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 08:44:20.462601 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.462504    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T08:44:20.369669933Z","UUID":"2b84c8c8-32b4-4056-9b5f-b18d49caad1c","Handler":null,"Name":"","Endpoint":""}
Jun 03 08:44:20.464463 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.464442    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 08:44:20.464463 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.464467    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 08:44:20.489187 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.489145    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:20.489356 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.489160    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:20.489356 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:20.489269    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:20.489356 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:20.489337    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:20.598707 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.598632    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599114    2575 generic.go:358] "Generic (PLEG): container finished" podID="61adc58a-6601-40ea-8a45-80aae27478ce" containerID="a189e0b8316c0b8a214567c05bd9f1722b787566dcf3cb5e601a278f6f7786b4" exitCode=1
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599204    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerDied","Data":"a189e0b8316c0b8a214567c05bd9f1722b787566dcf3cb5e601a278f6f7786b4"}
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599234    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"bfedcf6a20c10f2aa64a351d1d2a28fad904482e51c7816a7d07e0f6c87ffad4"}
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599248    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"61771eb456d5cf9aacbeb1b9130a883d23c6193d52379689dadc913a0e84c8d1"}
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599264    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"08fa5d5e037136babe6118ea11d1c2e3146bef937646c4947fb39b710a7c9eb6"}
Jun 03 08:44:20.599411 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.599278    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"cb312fcc35c016b4f6ff5513528460ee3694ab4a76716ab12af68b8ca21598f9"}
Jun 03 08:44:20.601737 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.601711    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp" event={"ID":"2d8df654-e9b2-43e7-8d06-46f45549b5b6","Type":"ContainerStarted","Data":"47faed453e54db2f560ef8c234657aab36d0ae768b58823336f868c08ca952b9"}
Jun 03 08:44:20.603199 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:20.603170    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-92hlr" event={"ID":"f590e96a-df80-428f-ac8d-5be5aa894931","Type":"ContainerStarted","Data":"7868c437158d02663525b2917167037196e8570511b63e3cc2570ffd8872359d"}
Jun 03 08:44:21.607495 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:21.607456    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp" event={"ID":"2d8df654-e9b2-43e7-8d06-46f45549b5b6","Type":"ContainerStarted","Data":"d3863001d4424a4cd2b688e38d201db96f9a2f75e99ca5b478f4bbb6e971c311"}
Jun 03 08:44:21.626169 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:21.626122    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-92hlr" podStartSLOduration=5.6054236589999995 podStartE2EDuration="23.626109546s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.938545443 +0000 UTC m=+2.971549578" lastFinishedPulling="2026-06-03 08:44:18.959231328 +0000 UTC m=+20.992235465" observedRunningTime="2026-06-03 08:44:20.617504863 +0000 UTC m=+22.650509018" watchObservedRunningTime="2026-06-03 08:44:21.626109546 +0000 UTC m=+23.659113702"
Jun 03 08:44:21.626396 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:21.626369    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btfbp" podStartSLOduration=3.124523086 podStartE2EDuration="23.626361287s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.945157822 +0000 UTC m=+2.978161956" lastFinishedPulling="2026-06-03 08:44:21.446996006 +0000 UTC m=+23.480000157" observedRunningTime="2026-06-03 08:44:21.625877541 +0000 UTC m=+23.658881698" watchObservedRunningTime="2026-06-03 08:44:21.626361287 +0000 UTC m=+23.659365445"
Jun 03 08:44:22.488767 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:22.488692    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:22.488949 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:22.488816    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:22.488949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:22.488883    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:22.489073 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:22.488987    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:24.102191 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.102014    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:24.102674 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.102657    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:24.489220 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.489197    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:24.489387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.489235    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:24.489387 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:24.489299    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:24.489501 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:24.489390    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:24.528486 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.528456    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qwhvr"]
Jun 03 08:44:24.530230 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.530212    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.532337 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.532320    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sxjkc\""
Jun 03 08:44:24.532494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.532481    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 08:44:24.532564 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.532533    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 08:44:24.591440 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.591414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl9dm\" (UniqueName: \"kubernetes.io/projected/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-kube-api-access-vl9dm\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.591567 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.591453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-hosts-file\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.591567 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.591476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-tmp-dir\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.615151 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.615128    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:44:24.615497 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.615460    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"c07deafa730f8d939fe3b29f123c811d09431d68cd3e5ca256ad0825e310f2b2"}
Jun 03 08:44:24.616829 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.616809    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="cc21e90b8f8c1e0de8a6258a25ca9a5649316b32b544d2a81bfe2a55e4d6e172" exitCode=0
Jun 03 08:44:24.616946 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.616896    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"cc21e90b8f8c1e0de8a6258a25ca9a5649316b32b544d2a81bfe2a55e4d6e172"}
Jun 03 08:44:24.617078 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.617065    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:24.617608 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.617593    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4d259"
Jun 03 08:44:24.692150 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.692116    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vl9dm\" (UniqueName: \"kubernetes.io/projected/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-kube-api-access-vl9dm\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.692285 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.692220    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-hosts-file\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.692285 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.692253    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-tmp-dir\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.692413 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.692388    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-hosts-file\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.692646 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.692630    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-tmp-dir\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.701993 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.701973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl9dm\" (UniqueName: \"kubernetes.io/projected/9ea1b578-ff80-4bcd-8375-6e8c67d9ad28-kube-api-access-vl9dm\") pod \"node-resolver-qwhvr\" (UID: \"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28\") " pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.841230 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:24.841163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwhvr"
Jun 03 08:44:24.848610 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:24.848580    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea1b578_ff80_4bcd_8375_6e8c67d9ad28.slice/crio-ab675a495bbfb3b5586bfb357f25c1f5de2c0d909bd8891256e1f90790899479 WatchSource:0}: Error finding container ab675a495bbfb3b5586bfb357f25c1f5de2c0d909bd8891256e1f90790899479: Status 404 returned error can't find the container with id ab675a495bbfb3b5586bfb357f25c1f5de2c0d909bd8891256e1f90790899479
Jun 03 08:44:25.620193 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:25.620155    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwhvr" event={"ID":"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28","Type":"ContainerStarted","Data":"5567f4860ed95654f597ebe9e8fdfa88e7e5b5b1efe131f202160084ba090719"}
Jun 03 08:44:25.620193 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:25.620194    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwhvr" event={"ID":"9ea1b578-ff80-4bcd-8375-6e8c67d9ad28","Type":"ContainerStarted","Data":"ab675a495bbfb3b5586bfb357f25c1f5de2c0d909bd8891256e1f90790899479"}
Jun 03 08:44:25.634225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:25.634188    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qwhvr" podStartSLOduration=1.634176263 podStartE2EDuration="1.634176263s" podCreationTimestamp="2026-06-03 08:44:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:44:25.633848468 +0000 UTC m=+27.666852624" watchObservedRunningTime="2026-06-03 08:44:25.634176263 +0000 UTC m=+27.667180418"
Jun 03 08:44:26.488636 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.488475    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:26.488777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.488481    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:26.488777 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:26.488710    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:26.488849 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:26.488780    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:26.623707 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.623670    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="862379e106b01a7ae8a2cbd6667bb32223e6503080b34186b6ed2ebb7f1f064f" exitCode=0
Jun 03 08:44:26.624214 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.623762    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"862379e106b01a7ae8a2cbd6667bb32223e6503080b34186b6ed2ebb7f1f064f"}
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.627020    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.628007    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"4df91c3c14f79da6234da9c608d778f9038ca3c7bf049b07ab826c7b652e2613"}
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.628289    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.628317    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.628333    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:26.630328 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.628578    2575 scope.go:117] "RemoveContainer" containerID="a189e0b8316c0b8a214567c05bd9f1722b787566dcf3cb5e601a278f6f7786b4"
Jun 03 08:44:26.646383 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.646361    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:26.646652 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:26.646631    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:44:27.632136 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.632049    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="1e4e2c19e3279ca371a4523b42c8fe96b6cb0afe99add8bcda5af3597c67d2ac" exitCode=0
Jun 03 08:44:27.632609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.632137    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"1e4e2c19e3279ca371a4523b42c8fe96b6cb0afe99add8bcda5af3597c67d2ac"}
Jun 03 08:44:27.636838 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.636819    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:44:27.637401 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.637212    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" event={"ID":"61adc58a-6601-40ea-8a45-80aae27478ce","Type":"ContainerStarted","Data":"8ebcc7e3ef3779f8584c4870a439d684afc4debb4e8b7f6a665172919dd33e4a"}
Jun 03 08:44:27.686724 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.686677    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm" podStartSLOduration=11.362217536 podStartE2EDuration="29.686661638s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.942265544 +0000 UTC m=+2.975269678" lastFinishedPulling="2026-06-03 08:44:19.266709642 +0000 UTC m=+21.299713780" observedRunningTime="2026-06-03 08:44:27.685926525 +0000 UTC m=+29.718930681" watchObservedRunningTime="2026-06-03 08:44:27.686661638 +0000 UTC m=+29.719665793"
Jun 03 08:44:27.884142 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.884065    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vgxx"]
Jun 03 08:44:27.884283 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.884213    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:27.884355 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:27.884330    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:27.888094 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.888069    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pfq86"]
Jun 03 08:44:27.888215 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:27.888184    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:27.888297 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:27.888274    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:28.243471 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.243241    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-z7rkh"]
Jun 03 08:44:28.245275 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.245253    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.245383 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.245332    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7rkh" podUID="2fa95dda-2a17-4a40-8b29-9458e6987dae"
Jun 03 08:44:28.256007 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.255979    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7rkh"]
Jun 03 08:44:28.319340 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.319086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.319505 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.319366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-dbus\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.319505 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.319440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-kubelet-config\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.422014    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.422060    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-dbus\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.422122    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-kubelet-config\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.422222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-kubelet-config\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.422329    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.422403    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret podName:2fa95dda-2a17-4a40-8b29-9458e6987dae nodeName:}" failed. No retries permitted until 2026-06-03 08:44:28.922384192 +0000 UTC m=+30.955388330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret") pod "global-pull-secret-syncer-z7rkh" (UID: "2fa95dda-2a17-4a40-8b29-9458e6987dae") : object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:28.422630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.422539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fa95dda-2a17-4a40-8b29-9458e6987dae-dbus\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.639368 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.639297    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.639779 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.639397    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7rkh" podUID="2fa95dda-2a17-4a40-8b29-9458e6987dae"
Jun 03 08:44:28.925277 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:28.925189    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:28.925440 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.925363    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:28.925492 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:28.925442    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret podName:2fa95dda-2a17-4a40-8b29-9458e6987dae nodeName:}" failed. No retries permitted until 2026-06-03 08:44:29.925420131 +0000 UTC m=+31.958424286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret") pod "global-pull-secret-syncer-z7rkh" (UID: "2fa95dda-2a17-4a40-8b29-9458e6987dae") : object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:29.488631 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:29.488601    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:29.488769 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:29.488666    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:29.488818 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:29.488761    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:29.488918 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:29.488893    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:29.934969 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:29.934885    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:29.935371 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:29.935051    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:29.935371 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:29.935137    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret podName:2fa95dda-2a17-4a40-8b29-9458e6987dae nodeName:}" failed. No retries permitted until 2026-06-03 08:44:31.935115935 +0000 UTC m=+33.968120084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret") pod "global-pull-secret-syncer-z7rkh" (UID: "2fa95dda-2a17-4a40-8b29-9458e6987dae") : object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:30.488581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:30.488550    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:30.488752 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:30.488660    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7rkh" podUID="2fa95dda-2a17-4a40-8b29-9458e6987dae"
Jun 03 08:44:31.489106 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.489072    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:31.489648 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:31.489200    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pfq86" podUID="5b5f3be0-ea62-47ad-a474-6e5a3b8d4332"
Jun 03 08:44:31.489648 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.489259    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:31.489648 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:31.489371    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:44:31.781538 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.781463    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-83.ec2.internal" event="NodeReady"
Jun 03 08:44:31.781694 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.781623    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 08:44:31.826029 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.825977    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bhkgt"]
Jun 03 08:44:31.845474 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.845439    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mgbrr"]
Jun 03 08:44:31.846024 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.845997    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:31.848119 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.848100    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 08:44:31.848246 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.848126    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 08:44:31.848410 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.848387    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jkth\""
Jun 03 08:44:31.861255 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.861233    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhkgt"]
Jun 03 08:44:31.861357 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.861264    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgbrr"]
Jun 03 08:44:31.861405 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.861367    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:31.863363 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.863339    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qg6q\""
Jun 03 08:44:31.863363 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.863382    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 08:44:31.863678 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.863658    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 08:44:31.864038 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.864009    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 08:44:31.949152 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c475-094f-4eb5-9d90-f7f07f993d15-tmp-dir\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:31.949320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:31.949320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:31.949320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd0c475-094f-4eb5-9d90-f7f07f993d15-config-volume\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:31.949491 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949357    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:31.949491 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfqk\" (UniqueName: \"kubernetes.io/projected/061cff9f-34d0-44f5-9cd1-0f7da0c66157-kube-api-access-pvfqk\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:31.949491 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:31.949420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2sx7\" (UniqueName: \"kubernetes.io/projected/4fd0c475-094f-4eb5-9d90-f7f07f993d15-kube-api-access-r2sx7\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:31.949614 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:31.949512    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:31.949614 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:31.949584    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret podName:2fa95dda-2a17-4a40-8b29-9458e6987dae nodeName:}" failed. No retries permitted until 2026-06-03 08:44:35.949562859 +0000 UTC m=+37.982566993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret") pod "global-pull-secret-syncer-z7rkh" (UID: "2fa95dda-2a17-4a40-8b29-9458e6987dae") : object "kube-system"/"original-pull-secret" not registered
Jun 03 08:44:32.050008 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.049928    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd0c475-094f-4eb5-9d90-f7f07f993d15-config-volume\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.050008 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.049997    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfqk\" (UniqueName: \"kubernetes.io/projected/061cff9f-34d0-44f5-9cd1-0f7da0c66157-kube-api-access-pvfqk\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:32.050210 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050026    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2sx7\" (UniqueName: \"kubernetes.io/projected/4fd0c475-094f-4eb5-9d90-f7f07f993d15-kube-api-access-r2sx7\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.050210 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050065    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c475-094f-4eb5-9d90-f7f07f993d15-tmp-dir\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.050312 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050200    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:32.050312 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050256    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.050412 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.050319    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:32.050412 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050374    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c475-094f-4eb5-9d90-f7f07f993d15-tmp-dir\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.050412 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.050377    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:32.050557 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.050381    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:32.550361031 +0000 UTC m=+34.583365170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:32.050557 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.050478    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:32.550461377 +0000 UTC m=+34.583465514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:32.050665 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.050555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd0c475-094f-4eb5-9d90-f7f07f993d15-config-volume\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.060794 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.060774    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2sx7\" (UniqueName: \"kubernetes.io/projected/4fd0c475-094f-4eb5-9d90-f7f07f993d15-kube-api-access-r2sx7\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.060943 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.060843    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfqk\" (UniqueName: \"kubernetes.io/projected/061cff9f-34d0-44f5-9cd1-0f7da0c66157-kube-api-access-pvfqk\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:32.151133 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.151101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:32.151326 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.151218    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:32.151326 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.151287    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:04.151260576 +0000 UTC m=+66.184264724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 08:44:32.251510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.251465    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:32.251694 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.251660    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 08:44:32.251694 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.251685    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 08:44:32.251789 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.251698    2575 projected.go:194] Error preparing data for projected volume kube-api-access-dlcln for pod openshift-network-diagnostics/network-check-target-pfq86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:32.251789 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.251776    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln podName:5b5f3be0-ea62-47ad-a474-6e5a3b8d4332 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:04.251756081 +0000 UTC m=+66.284760233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlcln" (UniqueName: "kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln") pod "network-check-target-pfq86" (UID: "5b5f3be0-ea62-47ad-a474-6e5a3b8d4332") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 08:44:32.488471 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.488434    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:32.490992 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.490967    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 08:44:32.554803 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.554767    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:32.554975 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:32.554820    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:32.554975 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.554911    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:32.555093 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.554974    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:32.555093 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.554990    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:33.554971354 +0000 UTC m=+35.587975491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:32.555093 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:32.555032    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:33.555013991 +0000 UTC m=+35.588018130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:33.489385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.489352    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:44:33.489564 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.489426    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:44:33.492710 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.492608    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 08:44:33.492710 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.492622    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 08:44:33.492710 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.492629    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nhrw\""
Jun 03 08:44:33.492710 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.492636    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 08:44:33.492710 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.492684    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llh4q\""
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.562889    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:33.562941    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:33.563091    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:33.563162    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:35.563143229 +0000 UTC m=+37.596147386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:33.563573    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:33.563647 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:33.563621    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:35.563606724 +0000 UTC m=+37.596610879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:34.653230 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:34.653152    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="f6568b0b823625f5316dd58bb7b6a5128e8a0e40b5d139e04f6c0fc088035dfe" exitCode=0
Jun 03 08:44:34.653230 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:34.653192    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"f6568b0b823625f5316dd58bb7b6a5128e8a0e40b5d139e04f6c0fc088035dfe"}
Jun 03 08:44:35.580287 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.580120    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:35.580479 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:35.580292    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:35.580479 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.580306    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:35.580479 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:35.580350    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:39.580335608 +0000 UTC m=+41.613339742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:35.580479 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:35.580424    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:35.580479 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:35.580479    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:39.580464201 +0000 UTC m=+41.613468348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:35.657558 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.657529    2575 generic.go:358] "Generic (PLEG): container finished" podID="2b5b960c-20ac-4652-bd3d-6cac49b2a58a" containerID="84492701d0a07240870f7f5edbe1f20f26eeba5e69e7aa2bd49cbc46c7dd3455" exitCode=0
Jun 03 08:44:35.657954 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.657572    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerDied","Data":"84492701d0a07240870f7f5edbe1f20f26eeba5e69e7aa2bd49cbc46c7dd3455"}
Jun 03 08:44:35.983247 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.983130    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:35.986149 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:35.986123    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fa95dda-2a17-4a40-8b29-9458e6987dae-original-pull-secret\") pod \"global-pull-secret-syncer-z7rkh\" (UID: \"2fa95dda-2a17-4a40-8b29-9458e6987dae\") " pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:36.101119 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:36.101088    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7rkh"
Jun 03 08:44:36.257468 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:36.257438    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7rkh"]
Jun 03 08:44:36.262897 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:44:36.262845    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa95dda_2a17_4a40_8b29_9458e6987dae.slice/crio-9b3710ceabf962298513ffef8972a9f24a10c9d754188ba8f0787d510c007123 WatchSource:0}: Error finding container 9b3710ceabf962298513ffef8972a9f24a10c9d754188ba8f0787d510c007123: Status 404 returned error can't find the container with id 9b3710ceabf962298513ffef8972a9f24a10c9d754188ba8f0787d510c007123
Jun 03 08:44:36.662390 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:36.662315    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" event={"ID":"2b5b960c-20ac-4652-bd3d-6cac49b2a58a","Type":"ContainerStarted","Data":"19d0fccdd9bababb0431f6f060290bb5f79fe50cff709828f9dc94b863dcf478"}
Jun 03 08:44:36.663295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:36.663266    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7rkh" event={"ID":"2fa95dda-2a17-4a40-8b29-9458e6987dae","Type":"ContainerStarted","Data":"9b3710ceabf962298513ffef8972a9f24a10c9d754188ba8f0787d510c007123"}
Jun 03 08:44:36.684528 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:36.684488    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5b6ws" podStartSLOduration=5.628367542 podStartE2EDuration="38.68446857s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:44:00.941982692 +0000 UTC m=+2.974986833" lastFinishedPulling="2026-06-03 08:44:33.998083725 +0000 UTC m=+36.031087861" observedRunningTime="2026-06-03 08:44:36.683285499 +0000 UTC m=+38.716289677" watchObservedRunningTime="2026-06-03 08:44:36.68446857 +0000 UTC m=+38.717472748"
Jun 03 08:44:39.611933 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:39.611887    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:39.611933 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:39.611939    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:39.612417 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:39.612036    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:39.612417 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:39.612104    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:47.612086421 +0000 UTC m=+49.645090578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:39.612417 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:39.612122    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:39.612417 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:39.612186    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:47.612168032 +0000 UTC m=+49.645172183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:40.672403 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:40.672370    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7rkh" event={"ID":"2fa95dda-2a17-4a40-8b29-9458e6987dae","Type":"ContainerStarted","Data":"9f05672765dcd38adb41ebc98f8b168ead05bb06bd811c762505b8c2ecd59540"}
Jun 03 08:44:40.686436 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:40.686394    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z7rkh" podStartSLOduration=8.801673224 podStartE2EDuration="12.686381758s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:36.264783886 +0000 UTC m=+38.297788020" lastFinishedPulling="2026-06-03 08:44:40.14949242 +0000 UTC m=+42.182496554" observedRunningTime="2026-06-03 08:44:40.685731441 +0000 UTC m=+42.718735597" watchObservedRunningTime="2026-06-03 08:44:40.686381758 +0000 UTC m=+42.719385910"
Jun 03 08:44:47.670044 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:47.670005    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:44:47.670044 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:47.670046    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:44:47.670517 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:47.670137    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:44:47.670517 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:47.670138    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:44:47.670517 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:47.670189    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:03.670174768 +0000 UTC m=+65.703178903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:44:47.670517 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:44:47.670202    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:03.670196793 +0000 UTC m=+65.703200927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:44:58.650173 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:44:58.650144    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwmxm"
Jun 03 08:45:03.675675 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:03.675639    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:45:03.675675 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:03.675679    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:45:03.676097 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:03.675771    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:45:03.676097 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:03.675772    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:45:03.676097 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:03.675821    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:35.675807793 +0000 UTC m=+97.708811926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:45:03.676097 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:03.675834    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:35.675828007 +0000 UTC m=+97.708832141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:45:04.178641 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.178599    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:45:04.181059 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.181041    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 08:45:04.189629 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:04.189614    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 08:45:04.189682 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:04.189673    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:08.189657111 +0000 UTC m=+130.222661260 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : secret "metrics-daemon-secret" not found
Jun 03 08:45:04.279852 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.279811    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:45:04.282179 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.282162    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 08:45:04.292667 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.292649    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 08:45:04.304398 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.304369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcln\" (UniqueName: \"kubernetes.io/projected/5b5f3be0-ea62-47ad-a474-6e5a3b8d4332-kube-api-access-dlcln\") pod \"network-check-target-pfq86\" (UID: \"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332\") " pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:45:04.407194 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.407168    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nhrw\""
Jun 03 08:45:04.415908 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.415889    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:45:04.546139 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.546105    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pfq86"]
Jun 03 08:45:04.549897 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:45:04.549870    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5f3be0_ea62_47ad_a474_6e5a3b8d4332.slice/crio-6f8c4295e32dc2293d77b20c2acd11227e6ba85310817bce460f308d62133e1b WatchSource:0}: Error finding container 6f8c4295e32dc2293d77b20c2acd11227e6ba85310817bce460f308d62133e1b: Status 404 returned error can't find the container with id 6f8c4295e32dc2293d77b20c2acd11227e6ba85310817bce460f308d62133e1b
Jun 03 08:45:04.718304 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:04.718227    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pfq86" event={"ID":"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332","Type":"ContainerStarted","Data":"6f8c4295e32dc2293d77b20c2acd11227e6ba85310817bce460f308d62133e1b"}
Jun 03 08:45:08.728119 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:08.728083    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pfq86" event={"ID":"5b5f3be0-ea62-47ad-a474-6e5a3b8d4332","Type":"ContainerStarted","Data":"ee7366686e85befd7563260a151f332dff387dd8d03d9d33c9e026a93f6fe04e"}
Jun 03 08:45:08.728497 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:08.728319    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:45:08.745121 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:08.745081    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pfq86" podStartSLOduration=67.46269168 podStartE2EDuration="1m10.745069516s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:45:04.551581687 +0000 UTC m=+66.584585821" lastFinishedPulling="2026-06-03 08:45:07.833959509 +0000 UTC m=+69.866963657" observedRunningTime="2026-06-03 08:45:08.744426437 +0000 UTC m=+70.777430594" watchObservedRunningTime="2026-06-03 08:45:08.745069516 +0000 UTC m=+70.778073671"
Jun 03 08:45:35.706797 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:35.706741    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:45:35.706797 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:35.706796    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:45:35.707357 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:35.706892    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:45:35.707357 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:35.706929    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:45:35.707357 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:35.706957    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:39.706941575 +0000 UTC m=+161.739945709 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:45:35.707357 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:45:35.706979    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:39.70696662 +0000 UTC m=+161.739970761 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:45:39.733039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:45:39.733009    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pfq86"
Jun 03 08:46:08.224082 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:08.224035    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:46:08.224581 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:08.224189    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 08:46:08.224581 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:08.224269    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs podName:63b283ff-0575-4c05-9717-ce0ec5f2dbc1 nodeName:}" failed. No retries permitted until 2026-06-03 08:48:10.224253199 +0000 UTC m=+252.257257332 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs") pod "network-metrics-daemon-2vgxx" (UID: "63b283ff-0575-4c05-9717-ce0ec5f2dbc1") : secret "metrics-daemon-secret" not found
Jun 03 08:46:34.835087 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.834922    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"]
Jun 03 08:46:34.840738 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.840713    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:34.843020 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.842996    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 03 08:46:34.843157 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.843073    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gmncx\""
Jun 03 08:46:34.843221 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.843198    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6987c77775-l82z4"]
Jun 03 08:46:34.843313 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.843203    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 08:46:34.844013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.843994    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 08:46:34.844131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.844109    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 03 08:46:34.845784 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.845765    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:34.847916 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.847650    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 03 08:46:34.848043 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848022    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 03 08:46:34.848487 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848468    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 08:46:34.848571 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848512    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7j9g7\""
Jun 03 08:46:34.848632 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848574    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 08:46:34.848770 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848754    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 03 08:46:34.848829 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.848783    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 03 08:46:34.850898 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.850881    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"]
Jun 03 08:46:34.857459 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:34.857437    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bhkgt" podUID="4fd0c475-094f-4eb5-9d90-f7f07f993d15"
Jun 03 08:46:34.869164 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.869138    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6987c77775-l82z4"]
Jun 03 08:46:34.871446 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:34.871421    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mgbrr" podUID="061cff9f-34d0-44f5-9cd1-0f7da0c66157"
Jun 03 08:46:34.889953 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.889929    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:46:34.934306 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.934283    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"]
Jun 03 08:46:34.937075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.937061    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:34.939169 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.939144    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gstc2\""
Jun 03 08:46:34.939169 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.939168    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 03 08:46:34.939339 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.939273    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 03 08:46:34.939339 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.939310    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 03 08:46:34.939556 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.939538    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 03 08:46:34.941026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.941004    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:46:34.943739 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.943719    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:34.946200 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.946181    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 08:46:34.946278 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.946205    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2xqvt\""
Jun 03 08:46:34.948026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.947984    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 08:46:34.948237 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.948221    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 08:46:34.948956 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.948937    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"]
Jun 03 08:46:34.954764 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.954744    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 08:46:34.960979 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.960958    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:46:34.999064 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:34.999180 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ade86b-17a9-46b2-857e-df00545095bf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:34.999180 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-default-certificate\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:34.999261 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:34.999261 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-stats-auth\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:34.999352 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:34.999352 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz5fl\" (UniqueName: \"kubernetes.io/projected/f4ade86b-17a9-46b2-857e-df00545095bf-kube-api-access-zz5fl\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:34.999352 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:34.999336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cls7b\" (UniqueName: \"kubernetes.io/projected/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-kube-api-access-cls7b\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.100211 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100211 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100211 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100268    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz5fl\" (UniqueName: \"kubernetes.io/projected/f4ade86b-17a9-46b2-857e-df00545095bf-kube-api-access-zz5fl\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100305    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cls7b\" (UniqueName: \"kubernetes.io/projected/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-kube-api-access-cls7b\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwsz9\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100378    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100473 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2626064-f336-440e-b5fa-f8a72355afdf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.100474    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.100542    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:35.600522633 +0000 UTC m=+157.633526803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : secret "router-metrics-certs-default" not found
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100578    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ade86b-17a9-46b2-857e-df00545095bf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfltg\" (UniqueName: \"kubernetes.io/projected/d2626064-f336-440e-b5fa-f8a72355afdf-kube-api-access-xfltg\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100662    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-default-certificate\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.100701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2626064-f336-440e-b5fa-f8a72355afdf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100723    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100749    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-stats-auth\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100829    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.100881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.100918    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:35.600898448 +0000 UTC m=+157.633902598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : configmap references non-existent config key: service-ca.crt
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.100943    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:35.101101 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.101018    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:35.600999778 +0000 UTC m=+157.634003921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:35.101325 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.101305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ade86b-17a9-46b2-857e-df00545095bf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.103031 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.103012    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-stats-auth\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.103107 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.103030    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-default-certificate\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.111185 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.111161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz5fl\" (UniqueName: \"kubernetes.io/projected/f4ade86b-17a9-46b2-857e-df00545095bf-kube-api-access-zz5fl\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.111330 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.111313    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cls7b\" (UniqueName: \"kubernetes.io/projected/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-kube-api-access-cls7b\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.202474 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202436    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202610 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202501    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2626064-f336-440e-b5fa-f8a72355afdf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.202610 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202557    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202610 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202593    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202756 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202629    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfltg\" (UniqueName: \"kubernetes.io/projected/d2626064-f336-440e-b5fa-f8a72355afdf-kube-api-access-xfltg\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.202756 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202673    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2626064-f336-440e-b5fa-f8a72355afdf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.202756 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202739    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202929 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202782    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202929 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202812    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202929 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202837    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.202929 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.202907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwsz9\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.205492 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.205451    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 08:46:35.205492 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.205493    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c44df9f97-r4v6h: secret "image-registry-tls" not found
Jun 03 08:46:35.205667 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.205647    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls podName:f35b6963-cb12-4fc4-8ac6-92622de3191f nodeName:}" failed. No retries permitted until 2026-06-03 08:46:35.705590789 +0000 UTC m=+157.738594936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls") pod "image-registry-c44df9f97-r4v6h" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f") : secret "image-registry-tls" not found
Jun 03 08:46:35.205738 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.205678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.206461 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.206437    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.206461 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.206449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.207068 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.207046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.207309 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.207286    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2626064-f336-440e-b5fa-f8a72355afdf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.207656 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.207634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.207726 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.207690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2626064-f336-440e-b5fa-f8a72355afdf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.212013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.211992    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwsz9\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.213605 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.213579    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.214050 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.214034    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfltg\" (UniqueName: \"kubernetes.io/projected/d2626064-f336-440e-b5fa-f8a72355afdf-kube-api-access-xfltg\") pod \"kube-storage-version-migrator-operator-96ddc787c-f5jtg\" (UID: \"d2626064-f336-440e-b5fa-f8a72355afdf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.246073 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.246055    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"
Jun 03 08:46:35.362069 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.362000    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg"]
Jun 03 08:46:35.365175 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:46:35.365143    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2626064_f336_440e_b5fa_f8a72355afdf.slice/crio-e7c1bba22bdfcbe112c2206096cfbe489a80d1c6dd3b488258d3f1b441ec4762 WatchSource:0}: Error finding container e7c1bba22bdfcbe112c2206096cfbe489a80d1c6dd3b488258d3f1b441ec4762: Status 404 returned error can't find the container with id e7c1bba22bdfcbe112c2206096cfbe489a80d1c6dd3b488258d3f1b441ec4762
Jun 03 08:46:35.606453 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.606407    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.606621 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.606497    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:35.606621 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.606527    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:35.606621 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.606567    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 08:46:35.606742 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.606625    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:35.606742 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.606643    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:36.606622842 +0000 UTC m=+158.639626991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : secret "router-metrics-certs-default" not found
Jun 03 08:46:35.606742 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.606660    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:36.606649669 +0000 UTC m=+158.639653821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:35.606742 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.606673    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:36.606666013 +0000 UTC m=+158.639670157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : configmap references non-existent config key: service-ca.crt
Jun 03 08:46:35.707140 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.707051    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:35.707273 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.707203    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 08:46:35.707273 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.707223    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c44df9f97-r4v6h: secret "image-registry-tls" not found
Jun 03 08:46:35.707358 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:35.707283    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls podName:f35b6963-cb12-4fc4-8ac6-92622de3191f nodeName:}" failed. No retries permitted until 2026-06-03 08:46:36.70726261 +0000 UTC m=+158.740266762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls") pod "image-registry-c44df9f97-r4v6h" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f") : secret "image-registry-tls" not found
Jun 03 08:46:35.893164 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:35.893122    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg" event={"ID":"d2626064-f336-440e-b5fa-f8a72355afdf","Type":"ContainerStarted","Data":"e7c1bba22bdfcbe112c2206096cfbe489a80d1c6dd3b488258d3f1b441ec4762"}
Jun 03 08:46:36.500118 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.500076    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2vgxx" podUID="63b283ff-0575-4c05-9717-ce0ec5f2dbc1"
Jun 03 08:46:36.615998 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:36.615961    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:36.615998 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:36.616001    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:36.616185 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:36.616078    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:36.616185 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.616128    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:38.616109949 +0000 UTC m=+160.649114093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : configmap references non-existent config key: service-ca.crt
Jun 03 08:46:36.616185 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.616179    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 08:46:36.616288 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.616181    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:36.616288 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.616237    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:38.616224006 +0000 UTC m=+160.649228142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : secret "router-metrics-certs-default" not found
Jun 03 08:46:36.616288 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.616254    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:38.616245556 +0000 UTC m=+160.649249704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:36.717266 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:36.717234    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:36.717453 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.717396    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 08:46:36.717453 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.717418    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c44df9f97-r4v6h: secret "image-registry-tls" not found
Jun 03 08:46:36.717568 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:36.717484    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls podName:f35b6963-cb12-4fc4-8ac6-92622de3191f nodeName:}" failed. No retries permitted until 2026-06-03 08:46:38.717461764 +0000 UTC m=+160.750465904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls") pod "image-registry-c44df9f97-r4v6h" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f") : secret "image-registry-tls" not found
Jun 03 08:46:37.898793 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:37.898755    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg" event={"ID":"d2626064-f336-440e-b5fa-f8a72355afdf","Type":"ContainerStarted","Data":"e43aeacbeb01d11dc346aea5e2c0cea4162cf9a63dcfb4235dadef23ece62806"}
Jun 03 08:46:37.916778 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:37.916733    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg" podStartSLOduration=1.7262917610000001 podStartE2EDuration="3.916719414s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:35.366825936 +0000 UTC m=+157.399830070" lastFinishedPulling="2026-06-03 08:46:37.557253587 +0000 UTC m=+159.590257723" observedRunningTime="2026-06-03 08:46:37.915898758 +0000 UTC m=+159.948902917" watchObservedRunningTime="2026-06-03 08:46:37.916719414 +0000 UTC m=+159.949723571"
Jun 03 08:46:38.632387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:38.632352    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:38.632387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:38.632392    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:38.632610 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.632490    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:38.632610 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.632531    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:42.632512008 +0000 UTC m=+164.665516161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : configmap references non-existent config key: service-ca.crt
Jun 03 08:46:38.632610 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.632593    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:42.632573245 +0000 UTC m=+164.665577383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:38.632714 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:38.632653    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:38.632768 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.632757    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 08:46:38.632804 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.632794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:42.632785592 +0000 UTC m=+164.665789726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : secret "router-metrics-certs-default" not found
Jun 03 08:46:38.733521 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:38.733497    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:38.733656 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.733632    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 08:46:38.733656 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.733647    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c44df9f97-r4v6h: secret "image-registry-tls" not found
Jun 03 08:46:38.733720 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:38.733691    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls podName:f35b6963-cb12-4fc4-8ac6-92622de3191f nodeName:}" failed. No retries permitted until 2026-06-03 08:46:42.733677836 +0000 UTC m=+164.766681969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls") pod "image-registry-c44df9f97-r4v6h" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f") : secret "image-registry-tls" not found
Jun 03 08:46:39.745460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:39.745429    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:46:39.745826 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:39.745470    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:46:39.745826 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:39.745573    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 08:46:39.745826 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:39.745583    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 08:46:39.745826 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:39.745631    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert podName:061cff9f-34d0-44f5-9cd1-0f7da0c66157 nodeName:}" failed. No retries permitted until 2026-06-03 08:48:41.745616075 +0000 UTC m=+283.778620224 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert") pod "ingress-canary-mgbrr" (UID: "061cff9f-34d0-44f5-9cd1-0f7da0c66157") : secret "canary-serving-cert" not found
Jun 03 08:46:39.745826 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:39.745646    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls podName:4fd0c475-094f-4eb5-9d90-f7f07f993d15 nodeName:}" failed. No retries permitted until 2026-06-03 08:48:41.745640188 +0000 UTC m=+283.778644322 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls") pod "dns-default-bhkgt" (UID: "4fd0c475-094f-4eb5-9d90-f7f07f993d15") : secret "dns-default-metrics-tls" not found
Jun 03 08:46:42.664585 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:42.664552    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:42.664585 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:42.664590    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:42.664641    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.664696    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:50.664680205 +0000 UTC m=+172.697684338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : configmap references non-existent config key: service-ca.crt
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.664728    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.664765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs podName:2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:50.664754453 +0000 UTC m=+172.697758587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs") pod "router-default-6987c77775-l82z4" (UID: "2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2") : secret "router-metrics-certs-default" not found
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.664770    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:42.665153 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.664826    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:50.664810092 +0000 UTC m=+172.697814226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:42.765680 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:42.765640    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:42.765849 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.765747    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 08:46:42.765849 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.765758    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c44df9f97-r4v6h: secret "image-registry-tls" not found
Jun 03 08:46:42.765849 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:42.765807    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls podName:f35b6963-cb12-4fc4-8ac6-92622de3191f nodeName:}" failed. No retries permitted until 2026-06-03 08:46:50.765792715 +0000 UTC m=+172.798796849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls") pod "image-registry-c44df9f97-r4v6h" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f") : secret "image-registry-tls" not found
Jun 03 08:46:42.910311 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:42.910282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwhvr_9ea1b578-ff80-4bcd-8375-6e8c67d9ad28/dns-node-resolver/0.log"
Jun 03 08:46:44.311698 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:44.311670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-twc8b_38ac16e4-5309-402e-98c3-d5dc027a90f1/node-ca/0.log"
Jun 03 08:46:45.711337 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:45.711260    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-f5jtg_d2626064-f336-440e-b5fa-f8a72355afdf/kube-storage-version-migrator-operator/0.log"
Jun 03 08:46:47.488822 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:47.488785    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:46:49.489352 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:49.489317    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:46:50.725391 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.725358    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:50.725391 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.725396    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:46:50.725834 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.725455    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:50.725834 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:50.725583    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:50.725834 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:46:50.725670    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls podName:f4ade86b-17a9-46b2-857e-df00545095bf nodeName:}" failed. No retries permitted until 2026-06-03 08:47:06.725648959 +0000 UTC m=+188.758653110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-jbkt2" (UID: "f4ade86b-17a9-46b2-857e-df00545095bf") : secret "cluster-monitoring-operator-tls" not found
Jun 03 08:46:50.726006 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.725989    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-service-ca-bundle\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:50.727925 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.727903    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2-metrics-certs\") pod \"router-default-6987c77775-l82z4\" (UID: \"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2\") " pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:50.757118 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.757093    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:50.826477 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.826441    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:50.828581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.828557    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"image-registry-c44df9f97-r4v6h\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") " pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:50.853190 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.853163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:50.882651 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.882621    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6987c77775-l82z4"]
Jun 03 08:46:50.885733 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:46:50.885707    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab52fb0_f868_4f7f_a7bf_c4bbfb59dbc2.slice/crio-ad168a532c6cd6b314ea3e9736f917c074a6999dfcd1e61c3f75fca04099865f WatchSource:0}: Error finding container ad168a532c6cd6b314ea3e9736f917c074a6999dfcd1e61c3f75fca04099865f: Status 404 returned error can't find the container with id ad168a532c6cd6b314ea3e9736f917c074a6999dfcd1e61c3f75fca04099865f
Jun 03 08:46:50.924385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.924354    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6987c77775-l82z4" event={"ID":"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2","Type":"ContainerStarted","Data":"ad168a532c6cd6b314ea3e9736f917c074a6999dfcd1e61c3f75fca04099865f"}
Jun 03 08:46:50.981225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:50.981147    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:46:50.984727 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:46:50.984702    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35b6963_cb12_4fc4_8ac6_92622de3191f.slice/crio-8a562ccfb663ab4210ef5d633041f8c1466e50bceda1c2365bbb17ae03f9230e WatchSource:0}: Error finding container 8a562ccfb663ab4210ef5d633041f8c1466e50bceda1c2365bbb17ae03f9230e: Status 404 returned error can't find the container with id 8a562ccfb663ab4210ef5d633041f8c1466e50bceda1c2365bbb17ae03f9230e
Jun 03 08:46:51.928361 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.928323    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" event={"ID":"f35b6963-cb12-4fc4-8ac6-92622de3191f","Type":"ContainerStarted","Data":"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"}
Jun 03 08:46:51.928361 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.928365    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" event={"ID":"f35b6963-cb12-4fc4-8ac6-92622de3191f","Type":"ContainerStarted","Data":"8a562ccfb663ab4210ef5d633041f8c1466e50bceda1c2365bbb17ae03f9230e"}
Jun 03 08:46:51.928827 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.928417    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:46:51.929578 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.929555    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6987c77775-l82z4" event={"ID":"2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2","Type":"ContainerStarted","Data":"15fafdd9b0bd278f67aede7d9b7f3a4b5cced30389bc4827082295b7b994ff94"}
Jun 03 08:46:51.949061 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.949018    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" podStartSLOduration=17.949006734 podStartE2EDuration="17.949006734s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:46:51.948171134 +0000 UTC m=+173.981175290" watchObservedRunningTime="2026-06-03 08:46:51.949006734 +0000 UTC m=+173.982010942"
Jun 03 08:46:51.966356 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:51.966310    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6987c77775-l82z4" podStartSLOduration=17.966294771 podStartE2EDuration="17.966294771s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:46:51.965705755 +0000 UTC m=+173.998709911" watchObservedRunningTime="2026-06-03 08:46:51.966294771 +0000 UTC m=+173.999298927"
Jun 03 08:46:52.757778 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:52.757743    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:52.760284 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:52.760262    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:52.932085 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:52.932051    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:46:52.933209 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:46:52.933186    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6987c77775-l82z4"
Jun 03 08:47:04.765982 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.765947    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:47:04.813666 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.813638    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hxx7p"]
Jun 03 08:47:04.816846 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.816826    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:04.819175 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.819145    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 08:47:04.819278 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.819148    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hqsvn\""
Jun 03 08:47:04.819348 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.819327    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 08:47:04.819479 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.819461    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 08:47:04.819746 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.819731    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 08:47:04.826837 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.826815    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxx7p"]
Jun 03 08:47:04.926576 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.926544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-crio-socket\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:04.926735 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.926604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-data-volume\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:04.926735 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.926629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:04.926735 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.926656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmw7l\" (UniqueName: \"kubernetes.io/projected/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-api-access-wmw7l\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:04.926853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:04.926751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027444    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-data-volume\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027471    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027494    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmw7l\" (UniqueName: \"kubernetes.io/projected/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-api-access-wmw7l\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027776 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027560    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027776 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027645    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-crio-socket\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027776 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027713    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-crio-socket\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.027959 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.027937    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-data-volume\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.028090 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.028074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.029895 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.029851    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.034785 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.034762    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmw7l\" (UniqueName: \"kubernetes.io/projected/81c9ecdf-8be3-485f-b75c-6fb59c9b3c45-kube-api-access-wmw7l\") pod \"insights-runtime-extractor-hxx7p\" (UID: \"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45\") " pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.126371 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.126345    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxx7p"
Jun 03 08:47:05.241072 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.241041    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxx7p"]
Jun 03 08:47:05.244606 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:05.244582    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c9ecdf_8be3_485f_b75c_6fb59c9b3c45.slice/crio-856a3d01d27ce7ba44ced28dae086b83f931212c9d620646f888e6bd932e30ea WatchSource:0}: Error finding container 856a3d01d27ce7ba44ced28dae086b83f931212c9d620646f888e6bd932e30ea: Status 404 returned error can't find the container with id 856a3d01d27ce7ba44ced28dae086b83f931212c9d620646f888e6bd932e30ea
Jun 03 08:47:05.964485 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.964454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxx7p" event={"ID":"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45","Type":"ContainerStarted","Data":"1e98de2ef5d57da0965987ce7b518113f4639a7072767b00293f67d869b55d50"}
Jun 03 08:47:05.964485 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:05.964489    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxx7p" event={"ID":"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45","Type":"ContainerStarted","Data":"856a3d01d27ce7ba44ced28dae086b83f931212c9d620646f888e6bd932e30ea"}
Jun 03 08:47:06.742167 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:06.742131    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:47:06.744776 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:06.744751    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ade86b-17a9-46b2-857e-df00545095bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-jbkt2\" (UID: \"f4ade86b-17a9-46b2-857e-df00545095bf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:47:06.953879 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:06.953832    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gmncx\""
Jun 03 08:47:06.962320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:06.962301    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"
Jun 03 08:47:06.968231 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:06.968199    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxx7p" event={"ID":"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45","Type":"ContainerStarted","Data":"73c39b106b56b4484a5077a4476380574b9f9274546e4f372c2eeb351737cce2"}
Jun 03 08:47:07.080704 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:07.080671    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2"]
Jun 03 08:47:07.083578 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:07.083553    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ade86b_17a9_46b2_857e_df00545095bf.slice/crio-daef799b26c3a6d8125a075acef92547fe6686089c73df247df275fea084cba9 WatchSource:0}: Error finding container daef799b26c3a6d8125a075acef92547fe6686089c73df247df275fea084cba9: Status 404 returned error can't find the container with id daef799b26c3a6d8125a075acef92547fe6686089c73df247df275fea084cba9
Jun 03 08:47:07.971228 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:07.971198    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2" event={"ID":"f4ade86b-17a9-46b2-857e-df00545095bf","Type":"ContainerStarted","Data":"daef799b26c3a6d8125a075acef92547fe6686089c73df247df275fea084cba9"}
Jun 03 08:47:08.977932 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:08.977881    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxx7p" event={"ID":"81c9ecdf-8be3-485f-b75c-6fb59c9b3c45","Type":"ContainerStarted","Data":"082f2b9f845d4983633546c2d8b90e6125cfa6c86a7acf4d541f0d19718e1586"}
Jun 03 08:47:08.979513 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:08.979480    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2" event={"ID":"f4ade86b-17a9-46b2-857e-df00545095bf","Type":"ContainerStarted","Data":"77322d358276f7b645026cd04fd1d3b92857602c0f0fadd38361787d9664e03f"}
Jun 03 08:47:09.014441 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.014399    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hxx7p" podStartSLOduration=2.312102974 podStartE2EDuration="5.014388237s" podCreationTimestamp="2026-06-03 08:47:04 +0000 UTC" firstStartedPulling="2026-06-03 08:47:05.295228982 +0000 UTC m=+187.328233115" lastFinishedPulling="2026-06-03 08:47:07.997514245 +0000 UTC m=+190.030518378" observedRunningTime="2026-06-03 08:47:09.014119139 +0000 UTC m=+191.047123294" watchObservedRunningTime="2026-06-03 08:47:09.014388237 +0000 UTC m=+191.047392393"
Jun 03 08:47:09.039754 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.039705    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-jbkt2" podStartSLOduration=33.293796078 podStartE2EDuration="35.039689339s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:47:07.08560175 +0000 UTC m=+189.118605886" lastFinishedPulling="2026-06-03 08:47:08.831495009 +0000 UTC m=+190.864499147" observedRunningTime="2026-06-03 08:47:09.039648041 +0000 UTC m=+191.072652197" watchObservedRunningTime="2026-06-03 08:47:09.039689339 +0000 UTC m=+191.072693498"
Jun 03 08:47:09.324297 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.324260    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"]
Jun 03 08:47:09.327734 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.327717    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:09.329698 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.329680    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 03 08:47:09.329790 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.329770    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mbqz7\""
Jun 03 08:47:09.336760 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.336737    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"]
Jun 03 08:47:09.362081 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.362051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02aab70c-8953-4a9c-ae57-cc785e76f163-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-cgdgj\" (UID: \"02aab70c-8953-4a9c-ae57-cc785e76f163\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:09.463116 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.463081    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02aab70c-8953-4a9c-ae57-cc785e76f163-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-cgdgj\" (UID: \"02aab70c-8953-4a9c-ae57-cc785e76f163\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:09.465388 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.465368    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/02aab70c-8953-4a9c-ae57-cc785e76f163-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-cgdgj\" (UID: \"02aab70c-8953-4a9c-ae57-cc785e76f163\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:09.640799 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.640718    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:09.775292 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.775255    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"]
Jun 03 08:47:09.778749 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:09.778723    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02aab70c_8953_4a9c_ae57_cc785e76f163.slice/crio-451595c779ccc7de7aededea29259b40e2d92dd91b71f67860beed8dac455eba WatchSource:0}: Error finding container 451595c779ccc7de7aededea29259b40e2d92dd91b71f67860beed8dac455eba: Status 404 returned error can't find the container with id 451595c779ccc7de7aededea29259b40e2d92dd91b71f67860beed8dac455eba
Jun 03 08:47:09.982894 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:09.982808    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj" event={"ID":"02aab70c-8953-4a9c-ae57-cc785e76f163","Type":"ContainerStarted","Data":"451595c779ccc7de7aededea29259b40e2d92dd91b71f67860beed8dac455eba"}
Jun 03 08:47:10.986594 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:10.986561    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj" event={"ID":"02aab70c-8953-4a9c-ae57-cc785e76f163","Type":"ContainerStarted","Data":"2dde0da18f20111a94483facfc64bc22c57eec60d2013b67d79fee368c2053fa"}
Jun 03 08:47:10.986992 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:10.986767    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:10.991366 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:10.991343    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj"
Jun 03 08:47:11.002079 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.002039    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-cgdgj" podStartSLOduration=1.010936214 podStartE2EDuration="2.0020261s" podCreationTimestamp="2026-06-03 08:47:09 +0000 UTC" firstStartedPulling="2026-06-03 08:47:09.780594562 +0000 UTC m=+191.813598699" lastFinishedPulling="2026-06-03 08:47:10.771684435 +0000 UTC m=+192.804688585" observedRunningTime="2026-06-03 08:47:11.00107218 +0000 UTC m=+193.034076340" watchObservedRunningTime="2026-06-03 08:47:11.0020261 +0000 UTC m=+193.035030257"
Jun 03 08:47:11.391061 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.391027    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"]
Jun 03 08:47:11.394227 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.394206    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.396340 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.396310    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 03 08:47:11.396340 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.396319    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 03 08:47:11.396943 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.396924    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6x7sc\""
Jun 03 08:47:11.396943 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.396936    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 08:47:11.402274 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.402256    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"]
Jun 03 08:47:11.478268 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.478231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.478268 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.478271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.478446 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.478340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclvr\" (UniqueName: \"kubernetes.io/projected/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-kube-api-access-hclvr\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.478446 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.478427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.579265 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.579232    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.579427 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.579277    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.579427 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.579319    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.579493 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:47:11.579483    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 03 08:47:11.579538 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.579520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hclvr\" (UniqueName: \"kubernetes.io/projected/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-kube-api-access-hclvr\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.579577 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:47:11.579540    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls podName:d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba nodeName:}" failed. No retries permitted until 2026-06-03 08:47:12.079522502 +0000 UTC m=+194.112526653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-jr5cs" (UID: "d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba") : secret "prometheus-operator-tls" not found
Jun 03 08:47:11.580116 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.580096    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.581585 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.581565    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:11.587434 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:11.587410    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclvr\" (UniqueName: \"kubernetes.io/projected/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-kube-api-access-hclvr\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:12.084044 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:12.084004    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:12.086354 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:12.086326    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jr5cs\" (UID: \"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:12.303056 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:12.303011    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"
Jun 03 08:47:12.418386 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:12.418357    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs"]
Jun 03 08:47:12.422169 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:12.422142    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67ef875_8c6f_4f7d_9d02_9596a7c8c2ba.slice/crio-b77b948ad617c0969b4956e0243ffad427df5012b134b2dc0ad378cee18a822d WatchSource:0}: Error finding container b77b948ad617c0969b4956e0243ffad427df5012b134b2dc0ad378cee18a822d: Status 404 returned error can't find the container with id b77b948ad617c0969b4956e0243ffad427df5012b134b2dc0ad378cee18a822d
Jun 03 08:47:12.992504 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:12.992467    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs" event={"ID":"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba","Type":"ContainerStarted","Data":"b77b948ad617c0969b4956e0243ffad427df5012b134b2dc0ad378cee18a822d"}
Jun 03 08:47:13.996042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:13.996009    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs" event={"ID":"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba","Type":"ContainerStarted","Data":"6ecce6db475bdc91d85695bdd82f88064624e4da271c45c99205c6948ea3689f"}
Jun 03 08:47:13.996042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:13.996043    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs" event={"ID":"d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba","Type":"ContainerStarted","Data":"17a03b21d0cf4c9f82fa27462532cbc423e6c03f98133194cdbf6daf02706171"}
Jun 03 08:47:14.016530 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:14.013088    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jr5cs" podStartSLOduration=1.804836757 podStartE2EDuration="3.013070076s" podCreationTimestamp="2026-06-03 08:47:11 +0000 UTC" firstStartedPulling="2026-06-03 08:47:12.424451664 +0000 UTC m=+194.457455801" lastFinishedPulling="2026-06-03 08:47:13.632684986 +0000 UTC m=+195.665689120" observedRunningTime="2026-06-03 08:47:14.011848774 +0000 UTC m=+196.044852930" watchObservedRunningTime="2026-06-03 08:47:14.013070076 +0000 UTC m=+196.046074234"
Jun 03 08:47:14.771921 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:14.771881    2575 patch_prober.go:28] interesting pod/image-registry-c44df9f97-r4v6h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 08:47:14.772087 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:14.771940    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 08:47:15.726877 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.726823    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"]
Jun 03 08:47:15.728932 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.728915    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.731611 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.731590    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 08:47:15.731727 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.731667    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sksq2\""
Jun 03 08:47:15.731908 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.731891    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 08:47:15.743925 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.743908    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"]
Jun 03 08:47:15.762888 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.762853    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gzpm5"]
Jun 03 08:47:15.765016 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.765003    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.767345 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.767316    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mxqg8\""
Jun 03 08:47:15.767478 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.767460    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 08:47:15.767637 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.767619    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 08:47:15.767947 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.767933    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 08:47:15.810360 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.810469 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-metrics-client-ca\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810469 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-textfile\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810469 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.810469 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d727496a-5225-47a9-8125-a9beabfe445e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.810680 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-sys\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810680 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-root\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810680 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-wtmp\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvqvl\" (UniqueName: \"kubernetes.io/projected/25ad73a8-78de-4b99-b8f7-abe92b277695-kube-api-access-wvqvl\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-tls\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.810972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.810832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndp9m\" (UniqueName: \"kubernetes.io/projected/d727496a-5225-47a9-8125-a9beabfe445e-kube-api-access-ndp9m\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.912116 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912086    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvqvl\" (UniqueName: \"kubernetes.io/projected/25ad73a8-78de-4b99-b8f7-abe92b277695-kube-api-access-wvqvl\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912241 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912121    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912241 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912142    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-tls\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912241 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912183    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndp9m\" (UniqueName: \"kubernetes.io/projected/d727496a-5225-47a9-8125-a9beabfe445e-kube-api-access-ndp9m\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.912241 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912219    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-metrics-client-ca\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912284    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-textfile\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912314    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912334    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d727496a-5225-47a9-8125-a9beabfe445e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912349    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-sys\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:47:15.912368    2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912402    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-root\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912433    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-wtmp\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:47:15.912448    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls podName:d727496a-5225-47a9-8125-a9beabfe445e nodeName:}" failed. No retries permitted until 2026-06-03 08:47:16.412427367 +0000 UTC m=+198.445431518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-qlf7f" (UID: "d727496a-5225-47a9-8125-a9beabfe445e") : secret "openshift-state-metrics-tls" not found
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-sys\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912499    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912547    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-wtmp\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912600    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25ad73a8-78de-4b99-b8f7-abe92b277695-root\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.912853 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912830    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-textfile\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.913176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.912946    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-metrics-client-ca\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.913176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.913111    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.913263 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.913212    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d727496a-5225-47a9-8125-a9beabfe445e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.914676 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.914651    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-tls\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.914762 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.914677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25ad73a8-78de-4b99-b8f7-abe92b277695-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:15.914903 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.914885    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.922784 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.922764    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndp9m\" (UniqueName: \"kubernetes.io/projected/d727496a-5225-47a9-8125-a9beabfe445e-kube-api-access-ndp9m\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:15.922888 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:15.922820    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvqvl\" (UniqueName: \"kubernetes.io/projected/25ad73a8-78de-4b99-b8f7-abe92b277695-kube-api-access-wvqvl\") pod \"node-exporter-gzpm5\" (UID: \"25ad73a8-78de-4b99-b8f7-abe92b277695\") " pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:16.073402 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.073371    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzpm5"
Jun 03 08:47:16.081500 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:16.081477    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ad73a8_78de_4b99_b8f7_abe92b277695.slice/crio-199fbc6d90cef4abb0bf18c9ab18d055e5deb82bae0565bf35fbaffd504a21d6 WatchSource:0}: Error finding container 199fbc6d90cef4abb0bf18c9ab18d055e5deb82bae0565bf35fbaffd504a21d6: Status 404 returned error can't find the container with id 199fbc6d90cef4abb0bf18c9ab18d055e5deb82bae0565bf35fbaffd504a21d6
Jun 03 08:47:16.416404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.416314    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:16.418612 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.418594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d727496a-5225-47a9-8125-a9beabfe445e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-qlf7f\" (UID: \"d727496a-5225-47a9-8125-a9beabfe445e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:16.638029 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.637979    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"
Jun 03 08:47:16.787908 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.787835    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-qlf7f"]
Jun 03 08:47:16.830490 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.830459    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:47:16.835050 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.835028    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.837609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837399    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 08:47:16.837609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837415    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 08:47:16.837609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837458    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 08:47:16.837609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837461    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rkr7\""
Jun 03 08:47:16.837609 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837556    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 08:47:16.838010 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837742    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 08:47:16.838010 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837902    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 08:47:16.838010 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.837923    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 08:47:16.838214 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.838198    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 08:47:16.838522 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.838504    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 08:47:16.848191 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.848156    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:47:16.921295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921617 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921617 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921719 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8r7h\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921719 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.921817 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.923349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.923349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.921980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.923349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.922057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.923349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:16.922144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:16.989511 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:16.989480    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd727496a_5225_47a9_8125_a9beabfe445e.slice/crio-eb1860a5fdc0685aceafe226e4c21a0d74f33cd14b39575f8205f0f9966fde03 WatchSource:0}: Error finding container eb1860a5fdc0685aceafe226e4c21a0d74f33cd14b39575f8205f0f9966fde03: Status 404 returned error can't find the container with id eb1860a5fdc0685aceafe226e4c21a0d74f33cd14b39575f8205f0f9966fde03
Jun 03 08:47:17.003842 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.003776    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f" event={"ID":"d727496a-5225-47a9-8125-a9beabfe445e","Type":"ContainerStarted","Data":"eb1860a5fdc0685aceafe226e4c21a0d74f33cd14b39575f8205f0f9966fde03"}
Jun 03 08:47:17.004753 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.004730    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzpm5" event={"ID":"25ad73a8-78de-4b99-b8f7-abe92b277695","Type":"ContainerStarted","Data":"199fbc6d90cef4abb0bf18c9ab18d055e5deb82bae0565bf35fbaffd504a21d6"}
Jun 03 08:47:17.023119 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023092    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023238 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023125    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023238 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023153    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023238 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023195    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023238 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023222    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023246    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023273    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023330    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023360    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023414    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.023475 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023446    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8r7h\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.025042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023477    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.025042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023512    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.025042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.023965    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.025042 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.024661    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.028393 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.028311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.028393 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.028353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.032337 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.028747    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.032337 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.028785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.032337 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.030594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.035011 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.033546    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.035632 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.035436    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.035632 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.035565    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.036469 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.036451    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.037603 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.037584    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.047989 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.047966    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8r7h\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h\") pod \"alertmanager-main-0\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.149019 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.148996    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:47:17.287123 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.287047    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:47:17.290838 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:17.290808    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186751b2_4db0_4e55_93a6_c8973140f365.slice/crio-3c15b13c13e7dafb846b11b77bc22d02aa7a670deffe4ad1d6e287ededb43749 WatchSource:0}: Error finding container 3c15b13c13e7dafb846b11b77bc22d02aa7a670deffe4ad1d6e287ededb43749: Status 404 returned error can't find the container with id 3c15b13c13e7dafb846b11b77bc22d02aa7a670deffe4ad1d6e287ededb43749
Jun 03 08:47:17.825299 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.825260    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-695cd667d6-sqx7r"]
Jun 03 08:47:17.827998 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.827977    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.830719 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.830649    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 03 08:47:17.830929 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.830908    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9rulmjso9o2j9\""
Jun 03 08:47:17.831030 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.830986    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 03 08:47:17.831127 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.831103    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 03 08:47:17.831240 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.831166    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 03 08:47:17.832295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.832271    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 03 08:47:17.832885 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.832841    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7k8ft\""
Jun 03 08:47:17.845292 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.845270    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-695cd667d6-sqx7r"]
Jun 03 08:47:17.931510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-grpc-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931668 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931668 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbmp\" (UniqueName: \"kubernetes.io/projected/79f37d18-4c67-4b6f-aba8-63e2714d7bef-kube-api-access-vvbmp\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931784 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931836 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f37d18-4c67-4b6f-aba8-63e2714d7bef-metrics-client-ca\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931913 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.931980 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:17.932020 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:17.931994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.009229 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.009201    2575 generic.go:358] "Generic (PLEG): container finished" podID="25ad73a8-78de-4b99-b8f7-abe92b277695" containerID="5207caa613a5bc9f7692df88885a47f3f9495297bba37d8c739ac0a7b9946777" exitCode=0
Jun 03 08:47:18.009344 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.009251    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzpm5" event={"ID":"25ad73a8-78de-4b99-b8f7-abe92b277695","Type":"ContainerDied","Data":"5207caa613a5bc9f7692df88885a47f3f9495297bba37d8c739ac0a7b9946777"}
Jun 03 08:47:18.010560 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.010536    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"3c15b13c13e7dafb846b11b77bc22d02aa7a670deffe4ad1d6e287ededb43749"}
Jun 03 08:47:18.012649 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.012624    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f" event={"ID":"d727496a-5225-47a9-8125-a9beabfe445e","Type":"ContainerStarted","Data":"7ab8c880c01ef4df54f345215f4d28ad0c2371cd6188f1d32851a9db868ccdcb"}
Jun 03 08:47:18.012761 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.012657    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f" event={"ID":"d727496a-5225-47a9-8125-a9beabfe445e","Type":"ContainerStarted","Data":"72e4ec96a4d575d68202a6293166f7bd97a5c6d5973d9f63984960d24b81a378"}
Jun 03 08:47:18.033087 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033059    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033203 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033125    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033203 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033155    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033227    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-grpc-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033251    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033277    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbmp\" (UniqueName: \"kubernetes.io/projected/79f37d18-4c67-4b6f-aba8-63e2714d7bef-kube-api-access-vvbmp\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033337    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.033581 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.033378    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f37d18-4c67-4b6f-aba8-63e2714d7bef-metrics-client-ca\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.034058 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.034009    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f37d18-4c67-4b6f-aba8-63e2714d7bef-metrics-client-ca\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.036670 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.036628    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.036670 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.036640    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.036996 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.036965    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-grpc-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.037169 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.037148    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.037412 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.037392    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-tls\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.038114 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.038075    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79f37d18-4c67-4b6f-aba8-63e2714d7bef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.041888 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.041845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbmp\" (UniqueName: \"kubernetes.io/projected/79f37d18-4c67-4b6f-aba8-63e2714d7bef-kube-api-access-vvbmp\") pod \"thanos-querier-695cd667d6-sqx7r\" (UID: \"79f37d18-4c67-4b6f-aba8-63e2714d7bef\") " pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.138671 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.138644    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:18.289072 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:18.289016    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-695cd667d6-sqx7r"]
Jun 03 08:47:18.428388 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:18.428316    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f37d18_4c67_4b6f_aba8_63e2714d7bef.slice/crio-97c41a3fbb0d29e8c3b18ea8bdecbf68e0287000117c12dd98ae561e21e42361 WatchSource:0}: Error finding container 97c41a3fbb0d29e8c3b18ea8bdecbf68e0287000117c12dd98ae561e21e42361: Status 404 returned error can't find the container with id 97c41a3fbb0d29e8c3b18ea8bdecbf68e0287000117c12dd98ae561e21e42361
Jun 03 08:47:19.017941 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.017912    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzpm5" event={"ID":"25ad73a8-78de-4b99-b8f7-abe92b277695","Type":"ContainerStarted","Data":"e6ab2b2a7e761599a38e5bdf5ff56ce89ab2d974ecb45556c64abeb42463f110"}
Jun 03 08:47:19.017941 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.017948    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzpm5" event={"ID":"25ad73a8-78de-4b99-b8f7-abe92b277695","Type":"ContainerStarted","Data":"3c6068059b67efe36bed087c4f71a49e925496c2460c40fba842e1ab27cfcfff"}
Jun 03 08:47:19.020088 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.020054    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="e6a670ddb0d60ceec9353c0097dbe60b8922132734997e4b7db2556d49f49053" exitCode=0
Jun 03 08:47:19.020229 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.020167    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"e6a670ddb0d60ceec9353c0097dbe60b8922132734997e4b7db2556d49f49053"}
Jun 03 08:47:19.022552 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.022525    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f" event={"ID":"d727496a-5225-47a9-8125-a9beabfe445e","Type":"ContainerStarted","Data":"2c72a83027278cd1b9a1afdb9a3740e8a2d65c4dbcb8a324d7adb2629d86bad4"}
Jun 03 08:47:19.023813 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.023782    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"97c41a3fbb0d29e8c3b18ea8bdecbf68e0287000117c12dd98ae561e21e42361"}
Jun 03 08:47:19.037162 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.037108    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gzpm5" podStartSLOduration=3.090089868 podStartE2EDuration="4.037090066s" podCreationTimestamp="2026-06-03 08:47:15 +0000 UTC" firstStartedPulling="2026-06-03 08:47:16.083446739 +0000 UTC m=+198.116450876" lastFinishedPulling="2026-06-03 08:47:17.030446935 +0000 UTC m=+199.063451074" observedRunningTime="2026-06-03 08:47:19.036257796 +0000 UTC m=+201.069261953" watchObservedRunningTime="2026-06-03 08:47:19.037090066 +0000 UTC m=+201.070094223"
Jun 03 08:47:19.053709 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:19.053597    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-qlf7f" podStartSLOduration=3.204646894 podStartE2EDuration="4.053581389s" podCreationTimestamp="2026-06-03 08:47:15 +0000 UTC" firstStartedPulling="2026-06-03 08:47:17.150093053 +0000 UTC m=+199.183097192" lastFinishedPulling="2026-06-03 08:47:17.999027535 +0000 UTC m=+200.032031687" observedRunningTime="2026-06-03 08:47:19.052800831 +0000 UTC m=+201.085804989" watchObservedRunningTime="2026-06-03 08:47:19.053581389 +0000 UTC m=+201.086585547"
Jun 03 08:47:20.043191 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.043152    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d9b474b59-hm2z6"]
Jun 03 08:47:20.045658 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.045632    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.048362 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048338    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 03 08:47:20.048484 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048382    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 08:47:20.048484 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048426    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 03 08:47:20.048484 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048462    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r85nd\""
Jun 03 08:47:20.048817 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048800    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 03 08:47:20.049002 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.048979    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-28smg0i7pl3us\""
Jun 03 08:47:20.063010 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.061613    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9b474b59-hm2z6"]
Jun 03 08:47:20.154433 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-audit-log\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.154603 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-client-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.154603 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.154778 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-metrics-server-audit-profiles\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.154890 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4swg\" (UniqueName: \"kubernetes.io/projected/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-kube-api-access-w4swg\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.154993 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.154973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-tls\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.155066 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.155021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-client-certs\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256002 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.255962    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-metrics-server-audit-profiles\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256028    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4swg\" (UniqueName: \"kubernetes.io/projected/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-kube-api-access-w4swg\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256076    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-tls\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256110    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-client-certs\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256176 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256154    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-audit-log\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256374 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256209    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-client-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.256374 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256253    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.257021 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.256969    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.257158 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.257017    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-audit-log\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.257158 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.257077    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-metrics-server-audit-profiles\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.258827 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.258803    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-tls\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.259145 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.259126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-client-ca-bundle\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.259199 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.259166    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-secret-metrics-server-client-certs\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.263510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.263489    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4swg\" (UniqueName: \"kubernetes.io/projected/3e95c5fa-74cb-43e7-bc8d-468237bc6d05-kube-api-access-w4swg\") pod \"metrics-server-d9b474b59-hm2z6\" (UID: \"3e95c5fa-74cb-43e7-bc8d-468237bc6d05\") " pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.357289 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.357207    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:20.983449 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.983417    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6548d5d997-h5bx6"]
Jun 03 08:47:20.989205 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.989143    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:20.991686 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.991651    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k27wz\""
Jun 03 08:47:20.991801 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.991769    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 03 08:47:20.991912 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.991900    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 03 08:47:20.992037 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.992012    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 03 08:47:20.992150 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.992111    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 03 08:47:20.992626 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.992601    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 03 08:47:20.997914 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:20.997891    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 03 08:47:21.003080 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.003056    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6548d5d997-h5bx6"]
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-serving-certs-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-metrics-client-ca\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-telemeter-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-federate-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.066766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.066651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckpw\" (UniqueName: \"kubernetes.io/projected/a44f7802-e817-477b-b502-6c351b344934-kube-api-access-cckpw\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.147822 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.147734    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d9b474b59-hm2z6"]
Jun 03 08:47:21.151454 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:21.151427    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e95c5fa_74cb_43e7_bc8d_468237bc6d05.slice/crio-a67efc277ac709a41e460ee51ba07eafdb8a61862a88b0b22635f014df84b13c WatchSource:0}: Error finding container a67efc277ac709a41e460ee51ba07eafdb8a61862a88b0b22635f014df84b13c: Status 404 returned error can't find the container with id a67efc277ac709a41e460ee51ba07eafdb8a61862a88b0b22635f014df84b13c
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167488    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-serving-certs-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167567    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167593    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-metrics-client-ca\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167627    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-telemeter-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167685    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167734    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167768    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-federate-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.167799    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cckpw\" (UniqueName: \"kubernetes.io/projected/a44f7802-e817-477b-b502-6c351b344934-kube-api-access-cckpw\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.169039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.168935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-serving-certs-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.171012 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.170948    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.171749 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.171580    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a44f7802-e817-477b-b502-6c351b344934-metrics-client-ca\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.172357 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.172312    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-telemeter-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.172957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.172750    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.173591 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.173550    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.173740 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.173724    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a44f7802-e817-477b-b502-6c351b344934-federate-client-tls\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.176218 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.176060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckpw\" (UniqueName: \"kubernetes.io/projected/a44f7802-e817-477b-b502-6c351b344934-kube-api-access-cckpw\") pod \"telemeter-client-6548d5d997-h5bx6\" (UID: \"a44f7802-e817-477b-b502-6c351b344934\") " pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.321535 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.321511    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6"
Jun 03 08:47:21.449976 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:21.449942    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6548d5d997-h5bx6"]
Jun 03 08:47:21.452710 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:21.452678    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44f7802_e817_477b_b502_6c351b344934.slice/crio-54e8ff8de533b64dbc747ba6ea2ab9afb624938257568f25c9dafa354a3aa9e2 WatchSource:0}: Error finding container 54e8ff8de533b64dbc747ba6ea2ab9afb624938257568f25c9dafa354a3aa9e2: Status 404 returned error can't find the container with id 54e8ff8de533b64dbc747ba6ea2ab9afb624938257568f25c9dafa354a3aa9e2
Jun 03 08:47:22.010455 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.010075    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:47:22.015769 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.015724    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.019684 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.019053    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 08:47:22.019684 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.019276    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 08:47:22.019684 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.019502    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 08:47:22.020140 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.019981    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 08:47:22.022577 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.020343    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 08:47:22.022577 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.020568    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aqs7g152kr8h7\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.026256    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.026554    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.026675    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.026792    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qpbkd\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.026967    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.027083    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 08:47:22.031830 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.028042    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 08:47:22.038892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.037451    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 08:47:22.046874 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.045202    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:47:22.057306 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.057190    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"ebd16798fc9c7edf7eb21e0ccdf454a10e6b638ab11cc3857858af6820644db5"}
Jun 03 08:47:22.057516 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.057495    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"3bdfa892e0618d6bd5a04c5865b577b285bde7da2b20b41efd04aad50894836f"}
Jun 03 08:47:22.057828 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.057814    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"e14b0255d41e4afe5f733353337a2161543f62dfb8f4b5283ce38f7b01be9c27"}
Jun 03 08:47:22.064292 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.064251    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6" event={"ID":"a44f7802-e817-477b-b502-6c351b344934","Type":"ContainerStarted","Data":"54e8ff8de533b64dbc747ba6ea2ab9afb624938257568f25c9dafa354a3aa9e2"}
Jun 03 08:47:22.065490 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.065403    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6" event={"ID":"3e95c5fa-74cb-43e7-bc8d-468237bc6d05","Type":"ContainerStarted","Data":"a67efc277ac709a41e460ee51ba07eafdb8a61862a88b0b22635f014df84b13c"}
Jun 03 08:47:22.073075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.073037    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"e8fcfed0c1a85ccc4d2253a9703ee67b4ff575ee74c18ba0f328f1e85269e66c"}
Jun 03 08:47:22.073075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.073067    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"aead76e38bbb520dc78757b03816a1a20a73906de23d3f2b3757b0c6c3ad47c4"}
Jun 03 08:47:22.073499 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.073081    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"69e5619fad728ffc46cfe2a655e9f333d47fe8f28e708fb61cd30c07c4e52914"}
Jun 03 08:47:22.073499 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.073093    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"06fbff432757ceaa1b79a5f16edca97a87085f2161e40be2259efcd1ade6dcd1"}
Jun 03 08:47:22.073499 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.073104    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"3dacc4a72c77a2a85e9b8b2d84e1cd2160a29400921786bc232aa898de6e5575"}
Jun 03 08:47:22.183311 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183478 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183330    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183478 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6lw\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183478 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.183786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.183987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.184178 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.184029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285269 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285235    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285405 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285373    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285405 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285396    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6lw\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285536 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285425    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285536 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285442    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285536 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285467    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285536 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285490    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285551    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285578    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285619    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285642    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285680    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285706    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285752    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.285821 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285781    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.286207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285848    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.286207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285894    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.286207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.285940    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.288235 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.287140    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.288235 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.287719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.289603 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.288789    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.291041 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.289783    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.291041 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.290217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.291041 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.290721    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.291522 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.291491    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.292048 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.292001    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.292332 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.292308    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.293972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.293590    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.293972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.293641    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.293972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.293825    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.293972 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.293932    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.294217 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.294047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.295299 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.295255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.295513 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.295460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.295690 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.295672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.319873 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.318768    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6lw\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw\") pod \"prometheus-k8s-0\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.342556 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.342521    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:22.954205 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:22.954174    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:47:22.956913 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:47:22.956873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96da4be7_38ce_4e32_8726_ac5b0ed2bc9a.slice/crio-4664b408fe6704196a6ed46a248520e1e1f8df3f22496e45db1526f6cba6297b WatchSource:0}: Error finding container 4664b408fe6704196a6ed46a248520e1e1f8df3f22496e45db1526f6cba6297b: Status 404 returned error can't find the container with id 4664b408fe6704196a6ed46a248520e1e1f8df3f22496e45db1526f6cba6297b
Jun 03 08:47:23.080031 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.079897    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"18055b8df7c016e9580ecae07cbdd440719b23e883f75fa1636e0407eb5b24ba"}
Jun 03 08:47:23.080031 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.079941    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"6f535284a938b1505695186bda05d50df97209e8997bf765dcf3f006c4aaf644"}
Jun 03 08:47:23.080031 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.079954    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" event={"ID":"79f37d18-4c67-4b6f-aba8-63e2714d7bef","Type":"ContainerStarted","Data":"5749cca12d7486a65880ee0bf4b74b54c937ddd4d44181bcae8b416618d14c15"}
Jun 03 08:47:23.080552 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.080055    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:23.081507 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.081470    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6" event={"ID":"3e95c5fa-74cb-43e7-bc8d-468237bc6d05","Type":"ContainerStarted","Data":"58bef0a0182b645dd3c35e92af3969d0881b7255a741b08a54b3f25eabadb994"}
Jun 03 08:47:23.084794 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.084768    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerStarted","Data":"d6db0b55f5b5399295d558a07e4762428c7df858156fa90ec397140c395acce1"}
Jun 03 08:47:23.086015 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.085995    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"4664b408fe6704196a6ed46a248520e1e1f8df3f22496e45db1526f6cba6297b"}
Jun 03 08:47:23.104945 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.104879    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r" podStartSLOduration=2.221985086 podStartE2EDuration="6.104850597s" podCreationTimestamp="2026-06-03 08:47:17 +0000 UTC" firstStartedPulling="2026-06-03 08:47:18.430260647 +0000 UTC m=+200.463264781" lastFinishedPulling="2026-06-03 08:47:22.313126156 +0000 UTC m=+204.346130292" observedRunningTime="2026-06-03 08:47:23.102903487 +0000 UTC m=+205.135907643" watchObservedRunningTime="2026-06-03 08:47:23.104850597 +0000 UTC m=+205.137854758"
Jun 03 08:47:23.130193 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.130149    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.116737269 podStartE2EDuration="7.13013562s" podCreationTimestamp="2026-06-03 08:47:16 +0000 UTC" firstStartedPulling="2026-06-03 08:47:17.292697951 +0000 UTC m=+199.325702085" lastFinishedPulling="2026-06-03 08:47:22.306096296 +0000 UTC m=+204.339100436" observedRunningTime="2026-06-03 08:47:23.128550606 +0000 UTC m=+205.161554763" watchObservedRunningTime="2026-06-03 08:47:23.13013562 +0000 UTC m=+205.163139773"
Jun 03 08:47:23.147005 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:23.146946    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6" podStartSLOduration=1.456095627 podStartE2EDuration="3.146928221s" podCreationTimestamp="2026-06-03 08:47:20 +0000 UTC" firstStartedPulling="2026-06-03 08:47:21.153829607 +0000 UTC m=+203.186833741" lastFinishedPulling="2026-06-03 08:47:22.844662185 +0000 UTC m=+204.877666335" observedRunningTime="2026-06-03 08:47:23.145096356 +0000 UTC m=+205.178100549" watchObservedRunningTime="2026-06-03 08:47:23.146928221 +0000 UTC m=+205.179932380"
Jun 03 08:47:24.091532 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.091495    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6" event={"ID":"a44f7802-e817-477b-b502-6c351b344934","Type":"ContainerStarted","Data":"fdb014d873dd2443541077c94df7e4640143c4d1672028b968ddef57a03e0ee8"}
Jun 03 08:47:24.091960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.091540    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6" event={"ID":"a44f7802-e817-477b-b502-6c351b344934","Type":"ContainerStarted","Data":"3ba6d27605450cd6513c72f4357f71c702455215aa4e88ab9dfecd21a6feb550"}
Jun 03 08:47:24.091960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.091558    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6" event={"ID":"a44f7802-e817-477b-b502-6c351b344934","Type":"ContainerStarted","Data":"0ece4a81c45fbba1f5e115b3fefd3cc5e9518418be2f9cbb0129711fb0fd8321"}
Jun 03 08:47:24.092773 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.092748    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f" exitCode=0
Jun 03 08:47:24.092918 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.092850    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f"}
Jun 03 08:47:24.112647 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.112604    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6548d5d997-h5bx6" podStartSLOduration=2.073023488 podStartE2EDuration="4.11258974s" podCreationTimestamp="2026-06-03 08:47:20 +0000 UTC" firstStartedPulling="2026-06-03 08:47:21.454479974 +0000 UTC m=+203.487484107" lastFinishedPulling="2026-06-03 08:47:23.494046225 +0000 UTC m=+205.527050359" observedRunningTime="2026-06-03 08:47:24.112472033 +0000 UTC m=+206.145476188" watchObservedRunningTime="2026-06-03 08:47:24.11258974 +0000 UTC m=+206.145593897"
Jun 03 08:47:24.771679 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.771644    2575 patch_prober.go:28] interesting pod/image-registry-c44df9f97-r4v6h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 08:47:24.771829 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:24.771704    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 08:47:27.107628 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:27.107601    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"}
Jun 03 08:47:27.107628 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:27.107636    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"}
Jun 03 08:47:28.113454 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:28.113419    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"}
Jun 03 08:47:28.113803 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:28.113460    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"}
Jun 03 08:47:28.113803 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:28.113474    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"}
Jun 03 08:47:28.113803 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:28.113487    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerStarted","Data":"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"}
Jun 03 08:47:28.140610 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:28.140556    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.326432716 podStartE2EDuration="7.140539741s" podCreationTimestamp="2026-06-03 08:47:21 +0000 UTC" firstStartedPulling="2026-06-03 08:47:24.094007623 +0000 UTC m=+206.127011757" lastFinishedPulling="2026-06-03 08:47:26.908114648 +0000 UTC m=+208.941118782" observedRunningTime="2026-06-03 08:47:28.140474223 +0000 UTC m=+210.173478389" watchObservedRunningTime="2026-06-03 08:47:28.140539741 +0000 UTC m=+210.173543879"
Jun 03 08:47:29.099394 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:29.099370    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-695cd667d6-sqx7r"
Jun 03 08:47:29.785009 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:29.784943    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry" containerID="cri-o://dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c" gracePeriod=30
Jun 03 08:47:30.028851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.028826    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071304    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071347    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071374    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071435    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071460    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwsz9\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071546    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071591    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.072815 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.071628    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted\") pod \"f35b6963-cb12-4fc4-8ac6-92622de3191f\" (UID: \"f35b6963-cb12-4fc4-8ac6-92622de3191f\") "
Jun 03 08:47:30.073344 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.073136    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:47:30.073786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.073737    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:47:30.075575 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.075530    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:47:30.075690 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.075581    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9" (OuterVolumeSpecName: "kube-api-access-nwsz9") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "kube-api-access-nwsz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:47:30.075690 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.075657    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:47:30.075810 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.075752    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:47:30.076022 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.076003    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:47:30.080651 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.080629    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f35b6963-cb12-4fc4-8ac6-92622de3191f" (UID: "f35b6963-cb12-4fc4-8ac6-92622de3191f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 08:47:30.121428 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.121390    2575 generic.go:358] "Generic (PLEG): container finished" podID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerID="dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c" exitCode=0
Jun 03 08:47:30.121625 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.121527    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" event={"ID":"f35b6963-cb12-4fc4-8ac6-92622de3191f","Type":"ContainerDied","Data":"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"}
Jun 03 08:47:30.121625 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.121557    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h" event={"ID":"f35b6963-cb12-4fc4-8ac6-92622de3191f","Type":"ContainerDied","Data":"8a562ccfb663ab4210ef5d633041f8c1466e50bceda1c2365bbb17ae03f9230e"}
Jun 03 08:47:30.121625 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.121576    2575 scope.go:117] "RemoveContainer" containerID="dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"
Jun 03 08:47:30.121780 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.121713    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c44df9f97-r4v6h"
Jun 03 08:47:30.137584 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.137554    2575 scope.go:117] "RemoveContainer" containerID="dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"
Jun 03 08:47:30.140003 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:47:30.139971    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c\": container with ID starting with dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c not found: ID does not exist" containerID="dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"
Jun 03 08:47:30.140105 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.140009    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c"} err="failed to get container status \"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c\": rpc error: code = NotFound desc = could not find container \"dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c\": container with ID starting with dc11d7fa0c79f993722eb75e9715d7ac7ff331d471331db59ea87106cf77f53c not found: ID does not exist"
Jun 03 08:47:30.146958 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.146931    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:47:30.148806 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.148781    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c44df9f97-r4v6h"]
Jun 03 08:47:30.172513 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172484    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-installation-pull-secrets\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172513 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172510    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-bound-sa-token\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172521    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f35b6963-cb12-4fc4-8ac6-92622de3191f-image-registry-private-configuration\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172532    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-certificates\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172541    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwsz9\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-kube-api-access-nwsz9\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172550    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f35b6963-cb12-4fc4-8ac6-92622de3191f-registry-tls\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172558    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f35b6963-cb12-4fc4-8ac6-92622de3191f-trusted-ca\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.172685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.172566    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f35b6963-cb12-4fc4-8ac6-92622de3191f-ca-trust-extracted\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:47:30.492994 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:30.492955    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" path="/var/lib/kubelet/pods/f35b6963-cb12-4fc4-8ac6-92622de3191f/volumes"
Jun 03 08:47:32.343056 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:32.343011    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:47:40.358200 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:40.358164    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:40.358200 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:40.358200    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:47:53.192936 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:53.192901    2575 generic.go:358] "Generic (PLEG): container finished" podID="d2626064-f336-440e-b5fa-f8a72355afdf" containerID="e43aeacbeb01d11dc346aea5e2c0cea4162cf9a63dcfb4235dadef23ece62806" exitCode=0
Jun 03 08:47:53.193332 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:53.192981    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg" event={"ID":"d2626064-f336-440e-b5fa-f8a72355afdf","Type":"ContainerDied","Data":"e43aeacbeb01d11dc346aea5e2c0cea4162cf9a63dcfb4235dadef23ece62806"}
Jun 03 08:47:53.193332 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:53.193293    2575 scope.go:117] "RemoveContainer" containerID="e43aeacbeb01d11dc346aea5e2c0cea4162cf9a63dcfb4235dadef23ece62806"
Jun 03 08:47:54.198349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:47:54.198309    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-f5jtg" event={"ID":"d2626064-f336-440e-b5fa-f8a72355afdf","Type":"ContainerStarted","Data":"a8a4ae378af1908406b140f7e539da881b2de798d1448897aec9e26d6f329b71"}
Jun 03 08:48:00.362806 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:00.362778    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:48:00.368101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:00.368079    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d9b474b59-hm2z6"
Jun 03 08:48:10.320633 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:10.320595    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:48:10.322835 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:10.322814    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63b283ff-0575-4c05-9717-ce0ec5f2dbc1-metrics-certs\") pod \"network-metrics-daemon-2vgxx\" (UID: \"63b283ff-0575-4c05-9717-ce0ec5f2dbc1\") " pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:48:10.592105 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:10.592029    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llh4q\""
Jun 03 08:48:10.600746 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:10.600728    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vgxx"
Jun 03 08:48:10.723869 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:10.723830    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vgxx"]
Jun 03 08:48:10.731911 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:48:10.727158    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b283ff_0575_4c05_9717_ce0ec5f2dbc1.slice/crio-b030d4df7c0d89e1875391e06fd6a51a82fd2de92edaf146488bab9ea0d1c5a1 WatchSource:0}: Error finding container b030d4df7c0d89e1875391e06fd6a51a82fd2de92edaf146488bab9ea0d1c5a1: Status 404 returned error can't find the container with id b030d4df7c0d89e1875391e06fd6a51a82fd2de92edaf146488bab9ea0d1c5a1
Jun 03 08:48:11.249495 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:11.249451    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vgxx" event={"ID":"63b283ff-0575-4c05-9717-ce0ec5f2dbc1","Type":"ContainerStarted","Data":"b030d4df7c0d89e1875391e06fd6a51a82fd2de92edaf146488bab9ea0d1c5a1"}
Jun 03 08:48:12.254122 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:12.254087    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vgxx" event={"ID":"63b283ff-0575-4c05-9717-ce0ec5f2dbc1","Type":"ContainerStarted","Data":"bcea91ca9039ae19536cb0116e5840a6de0cd7e4fcc04fa6b7a5baa534d8beb4"}
Jun 03 08:48:12.254122 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:12.254124    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vgxx" event={"ID":"63b283ff-0575-4c05-9717-ce0ec5f2dbc1","Type":"ContainerStarted","Data":"86d58f4d2d4281e960d5fce2d7f6028ab4e24958be0a5ccc9b147c18ceac682f"}
Jun 03 08:48:12.270913 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:12.270853    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2vgxx" podStartSLOduration=253.355788705 podStartE2EDuration="4m14.27083784s" podCreationTimestamp="2026-06-03 08:43:58 +0000 UTC" firstStartedPulling="2026-06-03 08:48:10.733546759 +0000 UTC m=+252.766550906" lastFinishedPulling="2026-06-03 08:48:11.6485959 +0000 UTC m=+253.681600041" observedRunningTime="2026-06-03 08:48:12.269773875 +0000 UTC m=+254.302778030" watchObservedRunningTime="2026-06-03 08:48:12.27083784 +0000 UTC m=+254.303841996"
Jun 03 08:48:15.393534 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:15.393509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwhvr_9ea1b578-ff80-4bcd-8375-6e8c67d9ad28/dns-node-resolver/0.log"
Jun 03 08:48:22.343718 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:22.343678    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:22.359137 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:22.359110    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:23.300827 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:23.300792    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:36.152688 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.152651    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:36.153449 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153419    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="alertmanager" containerID="cri-o://3dacc4a72c77a2a85e9b8b2d84e1cd2160a29400921786bc232aa898de6e5575" gracePeriod=120
Jun 03 08:48:36.153554 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153495    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-metric" containerID="cri-o://e8fcfed0c1a85ccc4d2253a9703ee67b4ff575ee74c18ba0f328f1e85269e66c" gracePeriod=120
Jun 03 08:48:36.153554 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153515    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-web" containerID="cri-o://69e5619fad728ffc46cfe2a655e9f333d47fe8f28e708fb61cd30c07c4e52914" gracePeriod=120
Jun 03 08:48:36.153655 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153534    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="prom-label-proxy" containerID="cri-o://d6db0b55f5b5399295d558a07e4762428c7df858156fa90ec397140c395acce1" gracePeriod=120
Jun 03 08:48:36.153655 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153599    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy" containerID="cri-o://aead76e38bbb520dc78757b03816a1a20a73906de23d3f2b3757b0c6c3ad47c4" gracePeriod=120
Jun 03 08:48:36.153655 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.153564    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="config-reloader" containerID="cri-o://06fbff432757ceaa1b79a5f16edca97a87085f2161e40be2259efcd1ade6dcd1" gracePeriod=120
Jun 03 08:48:36.334500 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334468    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="d6db0b55f5b5399295d558a07e4762428c7df858156fa90ec397140c395acce1" exitCode=0
Jun 03 08:48:36.334500 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334496    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="aead76e38bbb520dc78757b03816a1a20a73906de23d3f2b3757b0c6c3ad47c4" exitCode=0
Jun 03 08:48:36.334500 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334502    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="06fbff432757ceaa1b79a5f16edca97a87085f2161e40be2259efcd1ade6dcd1" exitCode=0
Jun 03 08:48:36.334500 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334508    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="3dacc4a72c77a2a85e9b8b2d84e1cd2160a29400921786bc232aa898de6e5575" exitCode=0
Jun 03 08:48:36.334723 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334535    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"d6db0b55f5b5399295d558a07e4762428c7df858156fa90ec397140c395acce1"}
Jun 03 08:48:36.334723 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334566    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"aead76e38bbb520dc78757b03816a1a20a73906de23d3f2b3757b0c6c3ad47c4"}
Jun 03 08:48:36.334723 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334576    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"06fbff432757ceaa1b79a5f16edca97a87085f2161e40be2259efcd1ade6dcd1"}
Jun 03 08:48:36.334723 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:36.334585    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"3dacc4a72c77a2a85e9b8b2d84e1cd2160a29400921786bc232aa898de6e5575"}
Jun 03 08:48:37.341557 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.341515    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="e8fcfed0c1a85ccc4d2253a9703ee67b4ff575ee74c18ba0f328f1e85269e66c" exitCode=0
Jun 03 08:48:37.341557 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.341543    2575 generic.go:358] "Generic (PLEG): container finished" podID="186751b2-4db0-4e55-93a6-c8973140f365" containerID="69e5619fad728ffc46cfe2a655e9f333d47fe8f28e708fb61cd30c07c4e52914" exitCode=0
Jun 03 08:48:37.341944 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.341598    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"e8fcfed0c1a85ccc4d2253a9703ee67b4ff575ee74c18ba0f328f1e85269e66c"}
Jun 03 08:48:37.341944 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.341654    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"69e5619fad728ffc46cfe2a655e9f333d47fe8f28e708fb61cd30c07c4e52914"}
Jun 03 08:48:37.391029 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.391008    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:37.446433 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446358    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446433 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446403    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446433 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446425    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446687 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446452    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446687 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446639    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446687 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446685    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446715    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446740    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446758    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446776    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446824    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.446851 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446849    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8r7h\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.447149 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.446968    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.447149 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.447014    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle\") pod \"186751b2-4db0-4e55-93a6-c8973140f365\" (UID: \"186751b2-4db0-4e55-93a6-c8973140f365\") "
Jun 03 08:48:37.447962 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.447327    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-main-db\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.447962 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.447725    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:37.448535 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.448507    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:37.449266 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.449220    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.449786 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.449751    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.450998 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.450972    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:48:37.452018 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.451994    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h" (OuterVolumeSpecName: "kube-api-access-g8r7h") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "kube-api-access-g8r7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:48:37.452390 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.452099    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out" (OuterVolumeSpecName: "config-out") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 08:48:37.452390 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.452230    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume" (OuterVolumeSpecName: "config-volume") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.452503 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.452415    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.452873 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.452826    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.457506 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.457396    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.463582 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.463562    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config" (OuterVolumeSpecName: "web-config") pod "186751b2-4db0-4e55-93a6-c8973140f365" (UID: "186751b2-4db0-4e55-93a6-c8973140f365"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:37.548787 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548747    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-web-config\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.548787 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548779    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.548787 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548793    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/186751b2-4db0-4e55-93a6-c8973140f365-config-out\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548807    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-tls-assets\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548820    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-main-tls\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548832    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-cluster-tls-config\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548845    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8r7h\" (UniqueName: \"kubernetes.io/projected/186751b2-4db0-4e55-93a6-c8973140f365-kube-api-access-g8r7h\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548881    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-metrics-client-ca\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548898    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/186751b2-4db0-4e55-93a6-c8973140f365-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548911    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548923    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-config-volume\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.549060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:37.548937    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/186751b2-4db0-4e55-93a6-c8973140f365-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:37.890881 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:37.890822    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bhkgt" podUID="4fd0c475-094f-4eb5-9d90-f7f07f993d15"
Jun 03 08:48:38.347146 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.347112    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"186751b2-4db0-4e55-93a6-c8973140f365","Type":"ContainerDied","Data":"3c15b13c13e7dafb846b11b77bc22d02aa7a670deffe4ad1d6e287ededb43749"}
Jun 03 08:48:38.347146 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.347149    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:38.347590 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.347166    2575 scope.go:117] "RemoveContainer" containerID="d6db0b55f5b5399295d558a07e4762428c7df858156fa90ec397140c395acce1"
Jun 03 08:48:38.347590 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.347288    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.354669 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.354553    2575 scope.go:117] "RemoveContainer" containerID="e8fcfed0c1a85ccc4d2253a9703ee67b4ff575ee74c18ba0f328f1e85269e66c"
Jun 03 08:48:38.361518 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.361502    2575 scope.go:117] "RemoveContainer" containerID="aead76e38bbb520dc78757b03816a1a20a73906de23d3f2b3757b0c6c3ad47c4"
Jun 03 08:48:38.367667 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.367651    2575 scope.go:117] "RemoveContainer" containerID="69e5619fad728ffc46cfe2a655e9f333d47fe8f28e708fb61cd30c07c4e52914"
Jun 03 08:48:38.370835 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.370777    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:38.375481 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.375458    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:38.375838 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.375821    2575 scope.go:117] "RemoveContainer" containerID="06fbff432757ceaa1b79a5f16edca97a87085f2161e40be2259efcd1ade6dcd1"
Jun 03 08:48:38.382422 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.382404    2575 scope.go:117] "RemoveContainer" containerID="3dacc4a72c77a2a85e9b8b2d84e1cd2160a29400921786bc232aa898de6e5575"
Jun 03 08:48:38.391057 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.391042    2575 scope.go:117] "RemoveContainer" containerID="e6a670ddb0d60ceec9353c0097dbe60b8922132734997e4b7db2556d49f49053"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.401924    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402353    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="prom-label-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402367    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="prom-label-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402380    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="init-config-reloader"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402388    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="init-config-reloader"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402400    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-web"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402408    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-web"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402418    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="config-reloader"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402426    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="config-reloader"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402435    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402443    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402459    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402469    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402478    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-metric"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402485    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-metric"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402498    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="alertmanager"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402505    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="alertmanager"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402582    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402592    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-metric"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402602    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="f35b6963-cb12-4fc4-8ac6-92622de3191f" containerName="registry"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402613    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="prom-label-proxy"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402623    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="config-reloader"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402635    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="kube-rbac-proxy-web"
Jun 03 08:48:38.403892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.402645    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="186751b2-4db0-4e55-93a6-c8973140f365" containerName="alertmanager"
Jun 03 08:48:38.408053 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.407955    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.411766    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.411788    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.412036    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.412038    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.412308    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.412496    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rkr7\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.412499    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.413767    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 08:48:38.423960 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.414252    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 08:48:38.427920 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.427897    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 08:48:38.428630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.428607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:38.456759 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-config-out\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.456759 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.456759 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457004 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457004 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457004 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457004 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.456963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457004 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457245 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gftgz\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-kube-api-access-gftgz\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457245 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457245 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457245 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.457245 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.457140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-web-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.492771 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.492744    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="186751b2-4db0-4e55-93a6-c8973140f365" path="/var/lib/kubelet/pods/186751b2-4db0-4e55-93a6-c8973140f365/volumes"
Jun 03 08:48:38.557823 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.557793    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558032 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.557878    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558032 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.557915    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558032 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.557974    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558032 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558025    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558248 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558072    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gftgz\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-kube-api-access-gftgz\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558248 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558140    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558248 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558180    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558397 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558273    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558397 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558315    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-web-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558397 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558345    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-config-out\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558397 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558381    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.558586 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558430    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.559332 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558761    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.559332 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.558901    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.559731 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.559711    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561223 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561160    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561317 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561667 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561645    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561757 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561757 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.561887 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.561761    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.562160 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.562135    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-web-config\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.562649 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.562631    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b941492-c709-4f9f-96b4-dfc503c185de-config-out\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.563257 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.563237    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b941492-c709-4f9f-96b4-dfc503c185de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.569715 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.569689    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gftgz\" (UniqueName: \"kubernetes.io/projected/6b941492-c709-4f9f-96b4-dfc503c185de-kube-api-access-gftgz\") pod \"alertmanager-main-0\" (UID: \"6b941492-c709-4f9f-96b4-dfc503c185de\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.726591 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.726515    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 08:48:38.862837 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:38.862810    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 08:48:38.865275 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:48:38.865236    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b941492_c709_4f9f_96b4_dfc503c185de.slice/crio-58344dd0ddb31b53fb16fa53e8e585f4fb49aa64a75492d4eb11fe8ebd01464e WatchSource:0}: Error finding container 58344dd0ddb31b53fb16fa53e8e585f4fb49aa64a75492d4eb11fe8ebd01464e: Status 404 returned error can't find the container with id 58344dd0ddb31b53fb16fa53e8e585f4fb49aa64a75492d4eb11fe8ebd01464e
Jun 03 08:48:39.352080 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:39.352044    2575 generic.go:358] "Generic (PLEG): container finished" podID="6b941492-c709-4f9f-96b4-dfc503c185de" containerID="cb54d09df36f04ac8182fe5bc336686dd2854068e625779ebcb6e3fb4a1cd250" exitCode=0
Jun 03 08:48:39.352080 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:39.352084    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerDied","Data":"cb54d09df36f04ac8182fe5bc336686dd2854068e625779ebcb6e3fb4a1cd250"}
Jun 03 08:48:39.352474 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:39.352105    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"58344dd0ddb31b53fb16fa53e8e585f4fb49aa64a75492d4eb11fe8ebd01464e"}
Jun 03 08:48:40.357419 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357382    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"3f7989caeb2e7daa71d041cce69bdbaf10a50dac062aabef9fa5dbc059e8485e"}
Jun 03 08:48:40.357419 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357424    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"1b3d03d0d25e24a4aeb73135470b951146801dc1cf6e565397ec9701b5b2745c"}
Jun 03 08:48:40.357831 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357438    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"7230dd3d2674226d18f375684385f91a9b66c17527eda2c79737823dd9f23746"}
Jun 03 08:48:40.357831 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357450    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"546a9edaa3c14419e2a285c09cf6401540266eb6528b1a2b2d7036b9da403700"}
Jun 03 08:48:40.357831 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357462    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"87e14a2c179e2d5ef437e314a0015e51307092c7cff836357df57cb41b6651ed"}
Jun 03 08:48:40.357831 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.357474    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b941492-c709-4f9f-96b4-dfc503c185de","Type":"ContainerStarted","Data":"3808730780d4c2fd185898dd9728fc712ac2b928b5c8fe5bb78508c3ee444d6f"}
Jun 03 08:48:40.382388 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382351    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:40.382983 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382948    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="prometheus" containerID="cri-o://1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c" gracePeriod=600
Jun 03 08:48:40.382983 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382966    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-web" containerID="cri-o://8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779" gracePeriod=600
Jun 03 08:48:40.383186 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382990    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2" gracePeriod=600
Jun 03 08:48:40.383186 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382976    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="config-reloader" containerID="cri-o://a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d" gracePeriod=600
Jun 03 08:48:40.383186 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.382964    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="thanos-sidecar" containerID="cri-o://d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f" gracePeriod=600
Jun 03 08:48:40.383186 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.383103    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy" containerID="cri-o://c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5" gracePeriod=600
Jun 03 08:48:40.389072 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:40.388548    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3885326940000002 podStartE2EDuration="2.388532694s" podCreationTimestamp="2026-06-03 08:48:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:48:40.385941077 +0000 UTC m=+282.418945230" watchObservedRunningTime="2026-06-03 08:48:40.388532694 +0000 UTC m=+282.421536866"
Jun 03 08:48:41.364307 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364274    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2" exitCode=0
Jun 03 08:48:41.364307 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364297    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5" exitCode=0
Jun 03 08:48:41.364307 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364305    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f" exitCode=0
Jun 03 08:48:41.364307 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364311    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d" exitCode=0
Jun 03 08:48:41.364307 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364317    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c" exitCode=0
Jun 03 08:48:41.364789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364341    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"}
Jun 03 08:48:41.364789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364373    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"}
Jun 03 08:48:41.364789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364384    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"}
Jun 03 08:48:41.364789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364394    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"}
Jun 03 08:48:41.364789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.364404    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"}
Jun 03 08:48:41.626553 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.626530    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:41.686388 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686360    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686394    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686427    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686444    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686460    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686485    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686513    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686546    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686571    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686597    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686635    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx6lw\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686668    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686693    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686732    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686765    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686796    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.686854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686836    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.687385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686901    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy\") pod \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\" (UID: \"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a\") "
Jun 03 08:48:41.687385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.686971    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:41.687385 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.687255    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.689309 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.688155    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:41.689588 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.689489    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 08:48:41.689970 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.689942    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out" (OuterVolumeSpecName: "config-out") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 08:48:41.690156 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.690131    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.690402 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.690379    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:41.690482 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.690419    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.691207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.691169    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:41.691207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.691182    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.691349 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.691274    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 08:48:41.691554 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.691532    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.691825 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.691787    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config" (OuterVolumeSpecName: "config") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.692872 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.692828    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:48:41.692986 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.692958    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.693375 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.693345    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.693450 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.693380    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.693685 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.693656    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw" (OuterVolumeSpecName: "kube-api-access-gx6lw") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "kube-api-access-gx6lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:48:41.703812 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.703760    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config" (OuterVolumeSpecName: "web-config") pod "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" (UID: "96da4be7-38ce-4e32-8726-ac5b0ed2bc9a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 08:48:41.788066 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:48:41.788244 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788080    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:41.788244 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788210    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788244 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788225    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-db\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788244 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788238    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788253    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788269    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-kube-rbac-proxy\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788282    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788297    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788313    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config-out\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788326    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-config\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788340    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788354    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-web-config\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788368    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788383    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-configmap-metrics-client-ca\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788398    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-grpc-tls\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788411    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx6lw\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-kube-api-access-gx6lw\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788425    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-secret-metrics-client-certs\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.788460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.788442    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a-tls-assets\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:48:41.790373 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.790349    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c475-094f-4eb5-9d90-f7f07f993d15-metrics-tls\") pod \"dns-default-bhkgt\" (UID: \"4fd0c475-094f-4eb5-9d90-f7f07f993d15\") " pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:41.790431 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.790417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/061cff9f-34d0-44f5-9cd1-0f7da0c66157-cert\") pod \"ingress-canary-mgbrr\" (UID: \"061cff9f-34d0-44f5-9cd1-0f7da0c66157\") " pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:48:41.950622 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.950593    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jkth\""
Jun 03 08:48:41.959304 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.959235    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:41.992849 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:41.992824    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qg6q\""
Jun 03 08:48:42.000757 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.000716    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgbrr"
Jun 03 08:48:42.089166 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.089138    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhkgt"]
Jun 03 08:48:42.092622 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:48:42.092595    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd0c475_094f_4eb5_9d90_f7f07f993d15.slice/crio-7fff83f2d3432edbbf07e13c4323ea0e17ca4c7a39a1f2c78e6dd9e9d911eb6d WatchSource:0}: Error finding container 7fff83f2d3432edbbf07e13c4323ea0e17ca4c7a39a1f2c78e6dd9e9d911eb6d: Status 404 returned error can't find the container with id 7fff83f2d3432edbbf07e13c4323ea0e17ca4c7a39a1f2c78e6dd9e9d911eb6d
Jun 03 08:48:42.138511 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.138481    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgbrr"]
Jun 03 08:48:42.141403 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:48:42.141372    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061cff9f_34d0_44f5_9cd1_0f7da0c66157.slice/crio-6b02ac2f38d3324c4c27c45e6949074b4c9e7450f148cfb85621271a0eb0010e WatchSource:0}: Error finding container 6b02ac2f38d3324c4c27c45e6949074b4c9e7450f148cfb85621271a0eb0010e: Status 404 returned error can't find the container with id 6b02ac2f38d3324c4c27c45e6949074b4c9e7450f148cfb85621271a0eb0010e
Jun 03 08:48:42.369638 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.369609    2575 generic.go:358] "Generic (PLEG): container finished" podID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerID="8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779" exitCode=0
Jun 03 08:48:42.370073 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.369697    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"}
Jun 03 08:48:42.370073 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.369737    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96da4be7-38ce-4e32-8726-ac5b0ed2bc9a","Type":"ContainerDied","Data":"4664b408fe6704196a6ed46a248520e1e1f8df3f22496e45db1526f6cba6297b"}
Jun 03 08:48:42.370073 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.369751    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.370073 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.369760    2575 scope.go:117] "RemoveContainer" containerID="58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"
Jun 03 08:48:42.370803 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.370781    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhkgt" event={"ID":"4fd0c475-094f-4eb5-9d90-f7f07f993d15","Type":"ContainerStarted","Data":"7fff83f2d3432edbbf07e13c4323ea0e17ca4c7a39a1f2c78e6dd9e9d911eb6d"}
Jun 03 08:48:42.371976 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.371954    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgbrr" event={"ID":"061cff9f-34d0-44f5-9cd1-0f7da0c66157","Type":"ContainerStarted","Data":"6b02ac2f38d3324c4c27c45e6949074b4c9e7450f148cfb85621271a0eb0010e"}
Jun 03 08:48:42.378202 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.378124    2575 scope.go:117] "RemoveContainer" containerID="c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"
Jun 03 08:48:42.386303 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.386288    2575 scope.go:117] "RemoveContainer" containerID="8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"
Jun 03 08:48:42.392518 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.392502    2575 scope.go:117] "RemoveContainer" containerID="d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"
Jun 03 08:48:42.396086 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.395327    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:42.399014 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.398996    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:42.400486 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.400460    2575 scope.go:117] "RemoveContainer" containerID="a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"
Jun 03 08:48:42.406672 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.406656    2575 scope.go:117] "RemoveContainer" containerID="1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"
Jun 03 08:48:42.413438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.413421    2575 scope.go:117] "RemoveContainer" containerID="f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f"
Jun 03 08:48:42.420049 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420010    2575 scope.go:117] "RemoveContainer" containerID="58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"
Jun 03 08:48:42.420303 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.420278    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2\": container with ID starting with 58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2 not found: ID does not exist" containerID="58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"
Jun 03 08:48:42.420379 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420357    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2"} err="failed to get container status \"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2\": rpc error: code = NotFound desc = could not find container \"58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2\": container with ID starting with 58f8105a2aad6cffbf42013454a094aff02ae2fb35a11819638aa4aba6092dc2 not found: ID does not exist"
Jun 03 08:48:42.420429 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420384    2575 scope.go:117] "RemoveContainer" containerID="c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"
Jun 03 08:48:42.420614 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.420596    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5\": container with ID starting with c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5 not found: ID does not exist" containerID="c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"
Jun 03 08:48:42.420698 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420627    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5"} err="failed to get container status \"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5\": rpc error: code = NotFound desc = could not find container \"c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5\": container with ID starting with c458a9d5ddb897614e4c7d2096be610af7c18a55660b8332d50d93500f92c1d5 not found: ID does not exist"
Jun 03 08:48:42.420698 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420649    2575 scope.go:117] "RemoveContainer" containerID="8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"
Jun 03 08:48:42.420922 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.420899    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779\": container with ID starting with 8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779 not found: ID does not exist" containerID="8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"
Jun 03 08:48:42.420975 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420932    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779"} err="failed to get container status \"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779\": rpc error: code = NotFound desc = could not find container \"8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779\": container with ID starting with 8d345f158a6fc37127956dd564f94386dc0e06f64167c8ca23925f32fb3fc779 not found: ID does not exist"
Jun 03 08:48:42.420975 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.420958    2575 scope.go:117] "RemoveContainer" containerID="d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"
Jun 03 08:48:42.421230 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.421210    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f\": container with ID starting with d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f not found: ID does not exist" containerID="d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"
Jun 03 08:48:42.421315 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421238    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f"} err="failed to get container status \"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f\": rpc error: code = NotFound desc = could not find container \"d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f\": container with ID starting with d26741b3b4cf62a9bcd818c21ad33a1bc5c841bbabbd2f403888239b6da6833f not found: ID does not exist"
Jun 03 08:48:42.421315 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421262    2575 scope.go:117] "RemoveContainer" containerID="a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"
Jun 03 08:48:42.421516 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.421494    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d\": container with ID starting with a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d not found: ID does not exist" containerID="a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"
Jun 03 08:48:42.421579 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421525    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d"} err="failed to get container status \"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d\": rpc error: code = NotFound desc = could not find container \"a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d\": container with ID starting with a64fd58da1805b1e4b7dd7899e9934ea62c6481e99f054e60a9d2eea0b7e780d not found: ID does not exist"
Jun 03 08:48:42.421579 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421546    2575 scope.go:117] "RemoveContainer" containerID="1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"
Jun 03 08:48:42.421770 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.421753    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c\": container with ID starting with 1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c not found: ID does not exist" containerID="1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"
Jun 03 08:48:42.421852 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421779    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c"} err="failed to get container status \"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c\": rpc error: code = NotFound desc = could not find container \"1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c\": container with ID starting with 1c47d78411af986f43b647a5e2c82a92bfc60f6076356d5c0dd9b709f1223f9c not found: ID does not exist"
Jun 03 08:48:42.421852 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.421798    2575 scope.go:117] "RemoveContainer" containerID="f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f"
Jun 03 08:48:42.422079 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:48:42.422049    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f\": container with ID starting with f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f not found: ID does not exist" containerID="f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f"
Jun 03 08:48:42.422079 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.422073    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f"} err="failed to get container status \"f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f\": rpc error: code = NotFound desc = could not find container \"f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f\": container with ID starting with f6f8a934a3a93a7f4f2421f08900d9921e8d9c378492389f269c1bc06cf9062f not found: ID does not exist"
Jun 03 08:48:42.424679 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.424662    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:42.425075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425056    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy"
Jun 03 08:48:42.425075 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425076    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425094    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="thanos-sidecar"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425102    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="thanos-sidecar"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425119    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="init-config-reloader"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425124    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="init-config-reloader"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425131    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="prometheus"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425136    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="prometheus"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425141    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-web"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425150    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-web"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425162    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-thanos"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425170    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-thanos"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425186    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="config-reloader"
Jun 03 08:48:42.425225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425192    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="config-reloader"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425250    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="config-reloader"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425258    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="thanos-sidecar"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425265    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="prometheus"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425273    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-web"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425278    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy"
Jun 03 08:48:42.425832 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.425286    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" containerName="kube-rbac-proxy-thanos"
Jun 03 08:48:42.428483 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.428465    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.431113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.430802    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 08:48:42.431113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.430804    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 08:48:42.431113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.430922    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 08:48:42.431113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.430809    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 08:48:42.431113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.430994    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 08:48:42.431404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431215    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qpbkd\""
Jun 03 08:48:42.431404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431236    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 08:48:42.431404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431263    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 08:48:42.431563 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431500    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 08:48:42.431563 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431528    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aqs7g152kr8h7\""
Jun 03 08:48:42.431563 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431552    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 08:48:42.431700 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.431635    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 08:48:42.435389 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.435369    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 08:48:42.438583 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.438564    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 08:48:42.443081 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.443060    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:42.493956 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.493893    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96da4be7-38ce-4e32-8726-ac5b0ed2bc9a" path="/var/lib/kubelet/pods/96da4be7-38ce-4e32-8726-ac5b0ed2bc9a/volumes"
Jun 03 08:48:42.494765 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.494907 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.494907 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.494907 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.494907 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495103 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495103 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495103 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.494979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495103 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495103 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lcz9\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-kube-api-access-4lcz9\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495320 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495551 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495551 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.495551 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.495432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596281    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596354    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596391    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596436    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596462    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596529    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596587    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596621    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.596662 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596647    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596677    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596705    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596727    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596752    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596778    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lcz9\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-kube-api-access-4lcz9\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596810    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596841    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.597305 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.596956    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.598644 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.598108    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.598886 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.598822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.602246 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.601493    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.602246 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.602177    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.602521 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.602463    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.602707    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.603107    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.603138    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.603244    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.603578    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.603777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.603727    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c3983e-f377-4762-8776-51426142cea1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.604219 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.604172    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c3983e-f377-4762-8776-51426142cea1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.605054 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.605004    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.605153 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.605132    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.605644 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.605627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-config\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.606394 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.606372    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.607168 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.607144    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c3983e-f377-4762-8776-51426142cea1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.609281 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.609241    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lcz9\" (UniqueName: \"kubernetes.io/projected/d4c3983e-f377-4762-8776-51426142cea1-kube-api-access-4lcz9\") pod \"prometheus-k8s-0\" (UID: \"d4c3983e-f377-4762-8776-51426142cea1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.741204 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.741176    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:42.905727 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:42.905669    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 08:48:42.908609 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:48:42.908574    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c3983e_f377_4762_8776_51426142cea1.slice/crio-66db64241a167bf36a83c83ee9cd37b82e9aa56f2b0c6b238f1a385e234b6a96 WatchSource:0}: Error finding container 66db64241a167bf36a83c83ee9cd37b82e9aa56f2b0c6b238f1a385e234b6a96: Status 404 returned error can't find the container with id 66db64241a167bf36a83c83ee9cd37b82e9aa56f2b0c6b238f1a385e234b6a96
Jun 03 08:48:43.379190 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:43.379108    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"cd19e770abf9b69adea86c211a287a78c1e13cd198936255bde07753ec0264ed"}
Jun 03 08:48:43.379190 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:43.379149    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"66db64241a167bf36a83c83ee9cd37b82e9aa56f2b0c6b238f1a385e234b6a96"}
Jun 03 08:48:44.383416 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.383382    2575 generic.go:358] "Generic (PLEG): container finished" podID="d4c3983e-f377-4762-8776-51426142cea1" containerID="cd19e770abf9b69adea86c211a287a78c1e13cd198936255bde07753ec0264ed" exitCode=0
Jun 03 08:48:44.383854 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.383462    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerDied","Data":"cd19e770abf9b69adea86c211a287a78c1e13cd198936255bde07753ec0264ed"}
Jun 03 08:48:44.385119 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.385099    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhkgt" event={"ID":"4fd0c475-094f-4eb5-9d90-f7f07f993d15","Type":"ContainerStarted","Data":"e71c70bc9a6bf05d5759bccdb1656389410bb566473861301fd525fa6a8dee13"}
Jun 03 08:48:44.385211 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.385123    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhkgt" event={"ID":"4fd0c475-094f-4eb5-9d90-f7f07f993d15","Type":"ContainerStarted","Data":"e30ce1bc867cf9c4f72ac4133aec5f0f60a42bc1212df79f5fe1a3bcb021f8c9"}
Jun 03 08:48:44.385277 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.385214    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:44.386479 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.386458    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgbrr" event={"ID":"061cff9f-34d0-44f5-9cd1-0f7da0c66157","Type":"ContainerStarted","Data":"e34b2b95fbf4688cfbbac153c85d085686b69c9e3c47d8a830d95774294325cc"}
Jun 03 08:48:44.427557 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.427509    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bhkgt" podStartSLOduration=251.640034189 podStartE2EDuration="4m13.427495476s" podCreationTimestamp="2026-06-03 08:44:31 +0000 UTC" firstStartedPulling="2026-06-03 08:48:42.095043053 +0000 UTC m=+284.128047186" lastFinishedPulling="2026-06-03 08:48:43.882504338 +0000 UTC m=+285.915508473" observedRunningTime="2026-06-03 08:48:44.425938679 +0000 UTC m=+286.458942835" watchObservedRunningTime="2026-06-03 08:48:44.427495476 +0000 UTC m=+286.460499631"
Jun 03 08:48:44.440408 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:44.440189    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mgbrr" podStartSLOduration=251.698699251 podStartE2EDuration="4m13.440169836s" podCreationTimestamp="2026-06-03 08:44:31 +0000 UTC" firstStartedPulling="2026-06-03 08:48:42.143346802 +0000 UTC m=+284.176350935" lastFinishedPulling="2026-06-03 08:48:43.884817382 +0000 UTC m=+285.917821520" observedRunningTime="2026-06-03 08:48:44.439139772 +0000 UTC m=+286.472143929" watchObservedRunningTime="2026-06-03 08:48:44.440169836 +0000 UTC m=+286.473173993"
Jun 03 08:48:45.393039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393000    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"a48349becef7c196ae6c63d9804738c583a81178899db18bdf2d2aa2c79b549b"}
Jun 03 08:48:45.393387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393053    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"934799ffbb5c25b9ae7e8d34982d468611c18846364f4ce9dc1dcb36edefe1e1"}
Jun 03 08:48:45.393387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393069    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"720c97c8483370f2c1c2e413ecd30ae83ede10b5f3a87dd92c443e2716bb586c"}
Jun 03 08:48:45.393387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393084    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"9b8d2ab4e7fc5207907db682e9be748a4675501c805b3d93aa620a88835cf013"}
Jun 03 08:48:45.393387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393096    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"a02a0fb939e8f7941e39efee4075d762692cb5a14bb041279b8b01ff4d922d88"}
Jun 03 08:48:45.393387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.393109    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c3983e-f377-4762-8776-51426142cea1","Type":"ContainerStarted","Data":"bd485b14a3d3f6301e1cbd7d9677457d219a26b49816ff6ea23b6a25d9e9112e"}
Jun 03 08:48:45.419391 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:45.419340    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.419325485 podStartE2EDuration="3.419325485s" podCreationTimestamp="2026-06-03 08:48:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:48:45.41760197 +0000 UTC m=+287.450606126" watchObservedRunningTime="2026-06-03 08:48:45.419325485 +0000 UTC m=+287.452329692"
Jun 03 08:48:47.741892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:47.741838    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:48:54.395936 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:54.395900    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bhkgt"
Jun 03 08:48:58.429888 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:58.429847    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:48:58.430444 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:48:58.430422    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:49:42.741511 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:49:42.741470    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:49:42.756949 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:49:42.756925    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:49:43.590162 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:49:43.590130    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 08:53:24.512154 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.512121    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gj9lv"]
Jun 03 08:53:24.515263 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.515245    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.517471 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.517451    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 03 08:53:24.518023 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.518004    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zbprc\""
Jun 03 08:53:24.518123 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.518034    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 03 08:53:24.523131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.523109    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gj9lv"]
Jun 03 08:53:24.577995 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.577957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn5sz\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-kube-api-access-rn5sz\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.578117 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.578005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.678614 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.678552    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rn5sz\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-kube-api-access-rn5sz\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.678614 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.678583    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.685683 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.685656    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.685844 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.685825    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn5sz\" (UniqueName: \"kubernetes.io/projected/1e963ea6-3094-4053-940f-6a5da22c08e4-kube-api-access-rn5sz\") pod \"cert-manager-cainjector-68b757865b-gj9lv\" (UID: \"1e963ea6-3094-4053-940f-6a5da22c08e4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.833208 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.833176    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv"
Jun 03 08:53:24.953967 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.953891    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gj9lv"]
Jun 03 08:53:24.957113 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:53:24.957081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e963ea6_3094_4053_940f_6a5da22c08e4.slice/crio-1f8c25d3d9cf25ce5f04dd5f4577c65a45a587541c52e4d5b3db4a8027cd2130 WatchSource:0}: Error finding container 1f8c25d3d9cf25ce5f04dd5f4577c65a45a587541c52e4d5b3db4a8027cd2130: Status 404 returned error can't find the container with id 1f8c25d3d9cf25ce5f04dd5f4577c65a45a587541c52e4d5b3db4a8027cd2130
Jun 03 08:53:24.959017 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:24.959001    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 08:53:25.228131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:25.228047    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv" event={"ID":"1e963ea6-3094-4053-940f-6a5da22c08e4","Type":"ContainerStarted","Data":"1f8c25d3d9cf25ce5f04dd5f4577c65a45a587541c52e4d5b3db4a8027cd2130"}
Jun 03 08:53:29.244131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:29.244097    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv" event={"ID":"1e963ea6-3094-4053-940f-6a5da22c08e4","Type":"ContainerStarted","Data":"104c669227fb29eec3856d8e29db71518902edf5dd67ccadc0e9f5702d4f16da"}
Jun 03 08:53:29.258800 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:29.258752    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-gj9lv" podStartSLOduration=1.253744764 podStartE2EDuration="5.258735977s" podCreationTimestamp="2026-06-03 08:53:24 +0000 UTC" firstStartedPulling="2026-06-03 08:53:24.959127361 +0000 UTC m=+566.992131494" lastFinishedPulling="2026-06-03 08:53:28.964118574 +0000 UTC m=+570.997122707" observedRunningTime="2026-06-03 08:53:29.2576011 +0000 UTC m=+571.290605257" watchObservedRunningTime="2026-06-03 08:53:29.258735977 +0000 UTC m=+571.291740134"
Jun 03 08:53:57.017250 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.017220    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"]
Jun 03 08:53:57.020630 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.020611    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.024654 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.024632    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 08:53:57.024921 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.024905    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlmg6\""
Jun 03 08:53:57.025058 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.025041    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 08:53:57.025321 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.025305    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 08:53:57.025321 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.025316    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 08:53:57.038838 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.038807    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"]
Jun 03 08:53:57.066084 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.066054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.066225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.066085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkpz\" (UniqueName: \"kubernetes.io/projected/14e505c9-13fc-4b74-996e-4877cfeac861-kube-api-access-5bkpz\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.066225 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.066120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.066350 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.066268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.066350 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.066315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167170 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167338 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167195    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167338 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167338 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167275    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkpz\" (UniqueName: \"kubernetes.io/projected/14e505c9-13fc-4b74-996e-4877cfeac861-kube-api-access-5bkpz\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167486 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167345    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.167610 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.167583    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.170017 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.169982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14e505c9-13fc-4b74-996e-4877cfeac861-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.170295 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.170276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.170404 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.170390    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14e505c9-13fc-4b74-996e-4877cfeac861-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.177990 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.177962    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkpz\" (UniqueName: \"kubernetes.io/projected/14e505c9-13fc-4b74-996e-4877cfeac861-kube-api-access-5bkpz\") pod \"opendatahub-operator-controller-manager-d95b9c768-gwkjq\" (UID: \"14e505c9-13fc-4b74-996e-4877cfeac861\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.333178 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.333089    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:53:57.465405 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:57.465378    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"]
Jun 03 08:53:57.467880 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:53:57.467838    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e505c9_13fc_4b74_996e_4877cfeac861.slice/crio-b75a5498288a90a7ac71e5ca9ee12d450e1a1ae0ad49029dea20faa499a2f8d7 WatchSource:0}: Error finding container b75a5498288a90a7ac71e5ca9ee12d450e1a1ae0ad49029dea20faa499a2f8d7: Status 404 returned error can't find the container with id b75a5498288a90a7ac71e5ca9ee12d450e1a1ae0ad49029dea20faa499a2f8d7
Jun 03 08:53:58.335523 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:58.335480    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq" event={"ID":"14e505c9-13fc-4b74-996e-4877cfeac861","Type":"ContainerStarted","Data":"b75a5498288a90a7ac71e5ca9ee12d450e1a1ae0ad49029dea20faa499a2f8d7"}
Jun 03 08:53:58.461645 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:58.461619    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:53:58.462013 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:53:58.461922    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:54:01.347590 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:01.347552    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq" event={"ID":"14e505c9-13fc-4b74-996e-4877cfeac861","Type":"ContainerStarted","Data":"793459c957123500bc5cd5ee10f91ef9f5fb22368cae08ba53615c567539c7e0"}
Jun 03 08:54:02.352526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:02.352488    2575 generic.go:358] "Generic (PLEG): container finished" podID="14e505c9-13fc-4b74-996e-4877cfeac861" containerID="793459c957123500bc5cd5ee10f91ef9f5fb22368cae08ba53615c567539c7e0" exitCode=0
Jun 03 08:54:02.352526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:02.352524    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq" event={"ID":"14e505c9-13fc-4b74-996e-4877cfeac861","Type":"ContainerDied","Data":"793459c957123500bc5cd5ee10f91ef9f5fb22368cae08ba53615c567539c7e0"}
Jun 03 08:54:03.357526 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:03.357492    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq" event={"ID":"14e505c9-13fc-4b74-996e-4877cfeac861","Type":"ContainerStarted","Data":"5bb49b5ab308964db8b74d80d5b3c7bfc88b1dd9fcfc1d59785fcf0e8c1c9ffd"}
Jun 03 08:54:03.358027 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:03.357629    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:54:03.381699 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:03.381654    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq" podStartSLOduration=2.165698459 podStartE2EDuration="7.381638031s" podCreationTimestamp="2026-06-03 08:53:56 +0000 UTC" firstStartedPulling="2026-06-03 08:53:57.469588441 +0000 UTC m=+599.502592575" lastFinishedPulling="2026-06-03 08:54:02.685528007 +0000 UTC m=+604.718532147" observedRunningTime="2026-06-03 08:54:03.379962586 +0000 UTC m=+605.412966742" watchObservedRunningTime="2026-06-03 08:54:03.381638031 +0000 UTC m=+605.414642225"
Jun 03 08:54:14.363948 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:14.363918    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-gwkjq"
Jun 03 08:54:22.156363 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.156285    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"]
Jun 03 08:54:22.159350 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.159334    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.162515 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.162489    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 08:54:22.162651 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.162603    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 08:54:22.163562 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.163544    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kqfqn\""
Jun 03 08:54:22.181136 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.181111    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"]
Jun 03 08:54:22.191719 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.191694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tls-certs\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.191837 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.191774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5qr\" (UniqueName: \"kubernetes.io/projected/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-kube-api-access-tq5qr\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.191901 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.191876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tmp\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.292389 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.292359    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5qr\" (UniqueName: \"kubernetes.io/projected/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-kube-api-access-tq5qr\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.292552 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.292417    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tmp\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.292552 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.292461    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tls-certs\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.294688 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.294660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tmp\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.294938 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.294920    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-tls-certs\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.299963 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.299937    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5qr\" (UniqueName: \"kubernetes.io/projected/a1298e6e-baa9-4fa9-9842-bc4e4e2b8283-kube-api-access-tq5qr\") pod \"kube-auth-proxy-b4fd57c-p7dgr\" (UID: \"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283\") " pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.469593 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.469516    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"
Jun 03 08:54:22.592594 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:22.592565    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr"]
Jun 03 08:54:22.594314 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:22.594287    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1298e6e_baa9_4fa9_9842_bc4e4e2b8283.slice/crio-530b99194fe62f9cddda829a99cd5bd98b83fbc83966cf684dd4762f0bc1afb8 WatchSource:0}: Error finding container 530b99194fe62f9cddda829a99cd5bd98b83fbc83966cf684dd4762f0bc1afb8: Status 404 returned error can't find the container with id 530b99194fe62f9cddda829a99cd5bd98b83fbc83966cf684dd4762f0bc1afb8
Jun 03 08:54:23.424379 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:23.424336    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr" event={"ID":"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283","Type":"ContainerStarted","Data":"530b99194fe62f9cddda829a99cd5bd98b83fbc83966cf684dd4762f0bc1afb8"}
Jun 03 08:54:25.432534 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:25.432495    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr" event={"ID":"a1298e6e-baa9-4fa9-9842-bc4e4e2b8283","Type":"ContainerStarted","Data":"ac74eed7fe41554168a066ea276894bf8651037af855e4da9ccbbf1400ec0dd3"}
Jun 03 08:54:25.451620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:25.451560    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b4fd57c-p7dgr" podStartSLOduration=0.784304589 podStartE2EDuration="3.451540673s" podCreationTimestamp="2026-06-03 08:54:22 +0000 UTC" firstStartedPulling="2026-06-03 08:54:22.596077965 +0000 UTC m=+624.629082099" lastFinishedPulling="2026-06-03 08:54:25.263314033 +0000 UTC m=+627.296318183" observedRunningTime="2026-06-03 08:54:25.450209219 +0000 UTC m=+627.483213387" watchObservedRunningTime="2026-06-03 08:54:25.451540673 +0000 UTC m=+627.484544829"
Jun 03 08:54:26.932817 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.932781    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"]
Jun 03 08:54:26.936303 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.936283    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:26.938948 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.938927    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 08:54:26.939046 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.938933    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wjbjs\""
Jun 03 08:54:26.943251 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.943185    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"]
Jun 03 08:54:26.946544 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.946528    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:26.949184 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.949163    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zlbbg\""
Jun 03 08:54:26.950792 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.950776    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 08:54:26.951216 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.951178    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"]
Jun 03 08:54:26.967640 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:26.967615    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"]
Jun 03 08:54:27.037839 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.037803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6p6w\" (UniqueName: \"kubernetes.io/projected/3258e9cf-6920-4df5-9be3-9630e409eae1-kube-api-access-z6p6w\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.038060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.037883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5tct\" (UniqueName: \"kubernetes.io/projected/f3d8203e-bc1e-464b-89a6-0928e7008e5e-kube-api-access-v5tct\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.038060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.037905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3258e9cf-6920-4df5-9be3-9630e409eae1-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.038060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.037989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3d8203e-bc1e-464b-89a6-0928e7008e5e-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.138638 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.138600    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3d8203e-bc1e-464b-89a6-0928e7008e5e-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.138925 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.138661    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6p6w\" (UniqueName: \"kubernetes.io/projected/3258e9cf-6920-4df5-9be3-9630e409eae1-kube-api-access-z6p6w\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.138925 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.138697    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5tct\" (UniqueName: \"kubernetes.io/projected/f3d8203e-bc1e-464b-89a6-0928e7008e5e-kube-api-access-v5tct\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.138925 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.138722    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3258e9cf-6920-4df5-9be3-9630e409eae1-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.141198 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.141168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3258e9cf-6920-4df5-9be3-9630e409eae1-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.141291 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.141262    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3d8203e-bc1e-464b-89a6-0928e7008e5e-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.152588 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.152560    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6p6w\" (UniqueName: \"kubernetes.io/projected/3258e9cf-6920-4df5-9be3-9630e409eae1-kube-api-access-z6p6w\") pod \"kserve-controller-manager-7c99ffcdcd-jd72j\" (UID: \"3258e9cf-6920-4df5-9be3-9630e409eae1\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.153520 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.153496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5tct\" (UniqueName: \"kubernetes.io/projected/f3d8203e-bc1e-464b-89a6-0928e7008e5e-kube-api-access-v5tct\") pod \"llmisvc-controller-manager-c6b9847d7-wlnfl\" (UID: \"f3d8203e-bc1e-464b-89a6-0928e7008e5e\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.246430 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.246400    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:27.257218 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.257189    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:27.399251 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.399227    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"]
Jun 03 08:54:27.401730 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:27.401693    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3258e9cf_6920_4df5_9be3_9630e409eae1.slice/crio-2872a6403e0b341713ca1603a00597338c252cd5c64bf8392b307c98a6dbb635 WatchSource:0}: Error finding container 2872a6403e0b341713ca1603a00597338c252cd5c64bf8392b307c98a6dbb635: Status 404 returned error can't find the container with id 2872a6403e0b341713ca1603a00597338c252cd5c64bf8392b307c98a6dbb635
Jun 03 08:54:27.414122 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.414101    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"]
Jun 03 08:54:27.416416 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:27.416384    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3d8203e_bc1e_464b_89a6_0928e7008e5e.slice/crio-70055f3000764c14bb1b1f2eacfb455921efe8ca94da65201b8b8ffddea66768 WatchSource:0}: Error finding container 70055f3000764c14bb1b1f2eacfb455921efe8ca94da65201b8b8ffddea66768: Status 404 returned error can't find the container with id 70055f3000764c14bb1b1f2eacfb455921efe8ca94da65201b8b8ffddea66768
Jun 03 08:54:27.440304 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.440279    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl" event={"ID":"f3d8203e-bc1e-464b-89a6-0928e7008e5e","Type":"ContainerStarted","Data":"70055f3000764c14bb1b1f2eacfb455921efe8ca94da65201b8b8ffddea66768"}
Jun 03 08:54:27.441334 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:27.441307    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j" event={"ID":"3258e9cf-6920-4df5-9be3-9630e409eae1","Type":"ContainerStarted","Data":"2872a6403e0b341713ca1603a00597338c252cd5c64bf8392b307c98a6dbb635"}
Jun 03 08:54:30.456315 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:30.456280    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j" event={"ID":"3258e9cf-6920-4df5-9be3-9630e409eae1","Type":"ContainerStarted","Data":"9e2a791c4855465ca4160fd1bff99d5d495cee3467b6243a4605f3267fcde449"}
Jun 03 08:54:30.456787 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:30.456346    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:54:30.472585 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:30.472537    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j" podStartSLOduration=1.608093862 podStartE2EDuration="4.472519033s" podCreationTimestamp="2026-06-03 08:54:26 +0000 UTC" firstStartedPulling="2026-06-03 08:54:27.403040037 +0000 UTC m=+629.436044174" lastFinishedPulling="2026-06-03 08:54:30.267465208 +0000 UTC m=+632.300469345" observedRunningTime="2026-06-03 08:54:30.470843054 +0000 UTC m=+632.503847237" watchObservedRunningTime="2026-06-03 08:54:30.472519033 +0000 UTC m=+632.505523190"
Jun 03 08:54:31.460608 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:31.460572    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl" event={"ID":"f3d8203e-bc1e-464b-89a6-0928e7008e5e","Type":"ContainerStarted","Data":"ec73e1baaf5af355698be72066df4d7811f59e065586d91bd0b01e0226d86c60"}
Jun 03 08:54:31.477550 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:31.477502    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl" podStartSLOduration=2.026877468 podStartE2EDuration="5.477488358s" podCreationTimestamp="2026-06-03 08:54:26 +0000 UTC" firstStartedPulling="2026-06-03 08:54:27.417625933 +0000 UTC m=+629.450630067" lastFinishedPulling="2026-06-03 08:54:30.86823682 +0000 UTC m=+632.901240957" observedRunningTime="2026-06-03 08:54:31.475543051 +0000 UTC m=+633.508547207" watchObservedRunningTime="2026-06-03 08:54:31.477488358 +0000 UTC m=+633.510492540"
Jun 03 08:54:32.463692 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:32.463657    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:54:37.866510 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.866477    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-zrjhd"]
Jun 03 08:54:37.869937 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.869920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:37.872157 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.872136    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jwpld\""
Jun 03 08:54:37.872278 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.872260    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 08:54:37.887789 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.887765    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-zrjhd"]
Jun 03 08:54:37.938474 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.938444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7937d31-264a-4931-a1b0-733206b66827-redirect-config\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:37.938620 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:37.938500    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtk8\" (UniqueName: \"kubernetes.io/projected/c7937d31-264a-4931-a1b0-733206b66827-kube-api-access-zgtk8\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.039357 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.039320    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7937d31-264a-4931-a1b0-733206b66827-redirect-config\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.039525 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.039384    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtk8\" (UniqueName: \"kubernetes.io/projected/c7937d31-264a-4931-a1b0-733206b66827-kube-api-access-zgtk8\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.040070 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.040052    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7937d31-264a-4931-a1b0-733206b66827-redirect-config\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.049038 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.049016    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtk8\" (UniqueName: \"kubernetes.io/projected/c7937d31-264a-4931-a1b0-733206b66827-kube-api-access-zgtk8\") pod \"dashboard-redirect-5c68945bf9-zrjhd\" (UID: \"c7937d31-264a-4931-a1b0-733206b66827\") " pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.180058 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.179977    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd"
Jun 03 08:54:38.322454 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.322423    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-zrjhd"]
Jun 03 08:54:38.335567 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:38.335537    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7937d31_264a_4931_a1b0_733206b66827.slice/crio-57fe7562d97b0c0a397b98c4a97dc9b055490cb4d29ca561061fa6924440dc74 WatchSource:0}: Error finding container 57fe7562d97b0c0a397b98c4a97dc9b055490cb4d29ca561061fa6924440dc74: Status 404 returned error can't find the container with id 57fe7562d97b0c0a397b98c4a97dc9b055490cb4d29ca561061fa6924440dc74
Jun 03 08:54:38.485730 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.485698    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd" event={"ID":"c7937d31-264a-4931-a1b0-733206b66827","Type":"ContainerStarted","Data":"57fe7562d97b0c0a397b98c4a97dc9b055490cb4d29ca561061fa6924440dc74"}
Jun 03 08:54:38.912694 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.912607    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"]
Jun 03 08:54:38.917426 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.917407    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:38.919533 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.919509    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 03 08:54:38.919834 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.919814    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-gf9wc\""
Jun 03 08:54:38.919938 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.919853    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 03 08:54:38.933509 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:38.933487    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"]
Jun 03 08:54:39.046841 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.046812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfq45\" (UniqueName: \"kubernetes.io/projected/c6e6581f-67c3-4c35-9fa6-30c783010096-kube-api-access-zfq45\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.047018 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.046849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c6e6581f-67c3-4c35-9fa6-30c783010096-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.148123 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.148092    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfq45\" (UniqueName: \"kubernetes.io/projected/c6e6581f-67c3-4c35-9fa6-30c783010096-kube-api-access-zfq45\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.148123 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.148134    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c6e6581f-67c3-4c35-9fa6-30c783010096-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.150656 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.150638    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c6e6581f-67c3-4c35-9fa6-30c783010096-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.155580 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.155552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfq45\" (UniqueName: \"kubernetes.io/projected/c6e6581f-67c3-4c35-9fa6-30c783010096-kube-api-access-zfq45\") pod \"servicemesh-operator3-55f49c5f94-pm6cd\" (UID: \"c6e6581f-67c3-4c35-9fa6-30c783010096\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.227268 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.227194    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:39.353460 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.353428    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"]
Jun 03 08:54:39.357110 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:39.357070    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e6581f_67c3_4c35_9fa6_30c783010096.slice/crio-c4224c78f35366329002159187fb79ec805ae8e463b4438b72375dff255f1980 WatchSource:0}: Error finding container c4224c78f35366329002159187fb79ec805ae8e463b4438b72375dff255f1980: Status 404 returned error can't find the container with id c4224c78f35366329002159187fb79ec805ae8e463b4438b72375dff255f1980
Jun 03 08:54:39.493818 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:39.493782    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd" event={"ID":"c6e6581f-67c3-4c35-9fa6-30c783010096","Type":"ContainerStarted","Data":"c4224c78f35366329002159187fb79ec805ae8e463b4438b72375dff255f1980"}
Jun 03 08:54:44.513003 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:44.512957    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd" event={"ID":"c7937d31-264a-4931-a1b0-733206b66827","Type":"ContainerStarted","Data":"b65a970056d842b66775fbfa7e085fdf84830fd5b9357003ff61d19019393af1"}
Jun 03 08:54:44.514420 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:44.514398    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd" event={"ID":"c6e6581f-67c3-4c35-9fa6-30c783010096","Type":"ContainerStarted","Data":"350b4beae725c3e3da6bfe73e18b9c331b7435b0813d2b42bf589a7e2613866c"}
Jun 03 08:54:44.514491 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:44.514449    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:44.531820 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:44.531775    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c68945bf9-zrjhd" podStartSLOduration=1.744528309 podStartE2EDuration="7.531761304s" podCreationTimestamp="2026-06-03 08:54:37 +0000 UTC" firstStartedPulling="2026-06-03 08:54:38.336961165 +0000 UTC m=+640.369965299" lastFinishedPulling="2026-06-03 08:54:44.124194154 +0000 UTC m=+646.157198294" observedRunningTime="2026-06-03 08:54:44.528670066 +0000 UTC m=+646.561674232" watchObservedRunningTime="2026-06-03 08:54:44.531761304 +0000 UTC m=+646.564765460"
Jun 03 08:54:44.552819 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:44.552770    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd" podStartSLOduration=1.800026131 podStartE2EDuration="6.552757245s" podCreationTimestamp="2026-06-03 08:54:38 +0000 UTC" firstStartedPulling="2026-06-03 08:54:39.359676002 +0000 UTC m=+641.392680135" lastFinishedPulling="2026-06-03 08:54:44.112407102 +0000 UTC m=+646.145411249" observedRunningTime="2026-06-03 08:54:44.55091512 +0000 UTC m=+646.583919277" watchObservedRunningTime="2026-06-03 08:54:44.552757245 +0000 UTC m=+646.585761400"
Jun 03 08:54:51.942421 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.942386    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"]
Jun 03 08:54:51.946365 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.946341    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:51.948482 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.948458    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 03 08:54:51.948482 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.948473    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 03 08:54:51.948653 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.948588    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xj42b\""
Jun 03 08:54:51.948653 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.948588    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 08:54:51.948745 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.948715    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 03 08:54:51.957892 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:51.957873    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"]
Jun 03 08:54:52.069936 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.069902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.069936 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.069940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.070131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.069975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.070131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.070045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aee9d71-f905-4e75-acb0-36fa57604985-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.070131 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.070087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnjv\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-kube-api-access-zqnjv\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.070235 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.070165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.070235 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.070184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171231 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171192    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171231 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171235    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171272    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171322    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aee9d71-f905-4e75-acb0-36fa57604985-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171366    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnjv\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-kube-api-access-zqnjv\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171431    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.171494 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.171456    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.172261 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.172237    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.174207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.174181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aee9d71-f905-4e75-acb0-36fa57604985-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.174314 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.174215    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.174380 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.174360    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.174436 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.174416    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aee9d71-f905-4e75-acb0-36fa57604985-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.179523 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.179502    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.179961 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.179939    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnjv\" (UniqueName: \"kubernetes.io/projected/4aee9d71-f905-4e75-acb0-36fa57604985-kube-api-access-zqnjv\") pod \"istiod-openshift-gateway-798958bb55-sqlx6\" (UID: \"4aee9d71-f905-4e75-acb0-36fa57604985\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.256196 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.256166    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:52.393383 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.393348    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"]
Jun 03 08:54:52.545817 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:52.545727    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6" event={"ID":"4aee9d71-f905-4e75-acb0-36fa57604985","Type":"ContainerStarted","Data":"b69a16f7bded3b7a3cc85d0be8e7bd03e59ada0cb97316435a6541d89288a7bc"}
Jun 03 08:54:54.876266 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:54.876215    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 08:54:54.876543 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:54.876303    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 08:54:55.520957 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.520910    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pm6cd"
Jun 03 08:54:55.562243 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.561105    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6" event={"ID":"4aee9d71-f905-4e75-acb0-36fa57604985","Type":"ContainerStarted","Data":"20492ef1d476b2615dffe9a3eeee93e3590945fed7f474a414380940dbe4dfe1"}
Jun 03 08:54:55.562243 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.561429    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:55.562841 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.562815    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-sqlx6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 03 08:54:55.562967 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.562913    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6" podUID="4aee9d71-f905-4e75-acb0-36fa57604985" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 08:54:55.585909 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:55.585835    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6" podStartSLOduration=2.118665534 podStartE2EDuration="4.585821143s" podCreationTimestamp="2026-06-03 08:54:51 +0000 UTC" firstStartedPulling="2026-06-03 08:54:52.40874582 +0000 UTC m=+654.441749957" lastFinishedPulling="2026-06-03 08:54:54.875901417 +0000 UTC m=+656.908905566" observedRunningTime="2026-06-03 08:54:55.584085062 +0000 UTC m=+657.617089219" watchObservedRunningTime="2026-06-03 08:54:55.585821143 +0000 UTC m=+657.618825299"
Jun 03 08:54:56.076511 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.076480    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"]
Jun 03 08:54:56.122134 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.122103    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"]
Jun 03 08:54:56.122319 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.122225    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.124736 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.124715    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lgzkj\""
Jun 03 08:54:56.212094 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212276 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212276 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212276 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97c1ab2-0417-422e-a80d-22f7e311a355-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212400 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212400 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctkg\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-kube-api-access-4ctkg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212490 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212490 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.212490 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.212484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.312991 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.312951    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.312991 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.312995    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313018    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313053    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313098    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313117    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313226 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313160    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97c1ab2-0417-422e-a80d-22f7e311a355-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313466 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313231    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313466 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313257    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctkg\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-kube-api-access-4ctkg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313572 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313464    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313572 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313529    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313701 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313685    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.313777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.313690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.314335 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.314305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97c1ab2-0417-422e-a80d-22f7e311a355-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.315523 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.315496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.315733 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.315715    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.328047 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.327991    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctkg\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-kube-api-access-4ctkg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.330129 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.330105    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97c1ab2-0417-422e-a80d-22f7e311a355-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb\" (UID: \"b97c1ab2-0417-422e-a80d-22f7e311a355\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.432498 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.432460    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:54:56.566093 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.566066    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqlx6"
Jun 03 08:54:56.575369 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:56.572917    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"]
Jun 03 08:54:56.577311 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:54:56.577281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97c1ab2_0417_422e_a80d_22f7e311a355.slice/crio-cd492ff05ef2d16adacf45bafde411716873077d660c42ea32e45eb17093129a WatchSource:0}: Error finding container cd492ff05ef2d16adacf45bafde411716873077d660c42ea32e45eb17093129a: Status 404 returned error can't find the container with id cd492ff05ef2d16adacf45bafde411716873077d660c42ea32e45eb17093129a
Jun 03 08:54:57.571438 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:57.571322    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb" event={"ID":"b97c1ab2-0417-422e-a80d-22f7e311a355","Type":"ContainerStarted","Data":"cd492ff05ef2d16adacf45bafde411716873077d660c42ea32e45eb17093129a"}
Jun 03 08:54:58.980370 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:58.980336    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 08:54:58.980622 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:58.980432    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 08:54:58.980622 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:58.980461    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 08:54:59.581113 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:59.581074    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb" event={"ID":"b97c1ab2-0417-422e-a80d-22f7e311a355","Type":"ContainerStarted","Data":"0782518cafc233027782f54b1882a26d368c2da44a24b24d71ac913a7b18f922"}
Jun 03 08:54:59.600769 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:54:59.600699    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb" podStartSLOduration=1.1995989200000001 podStartE2EDuration="3.600684367s" podCreationTimestamp="2026-06-03 08:54:56 +0000 UTC" firstStartedPulling="2026-06-03 08:54:56.578984807 +0000 UTC m=+658.611988941" lastFinishedPulling="2026-06-03 08:54:58.980070252 +0000 UTC m=+661.013074388" observedRunningTime="2026-06-03 08:54:59.599333071 +0000 UTC m=+661.632337226" watchObservedRunningTime="2026-06-03 08:54:59.600684367 +0000 UTC m=+661.633688521"
Jun 03 08:55:00.432644 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:00.432613    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:55:00.437336 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:00.437313    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:55:00.584777 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:00.584744    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:55:00.585839 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:00.585822    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb"
Jun 03 08:55:01.466524 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:01.466494    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jd72j"
Jun 03 08:55:03.469612 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:03.469578    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wlnfl"
Jun 03 08:55:52.530435 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.530353    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fxw92"]
Jun 03 08:55:52.532739 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.532721    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:52.536690 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.536670    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wmsg8\""
Jun 03 08:55:52.536690 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.536677    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 08:55:52.538299 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.538278    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 08:55:52.548520 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.548494    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fxw92"]
Jun 03 08:55:52.635039 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.635001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bw4j\" (UniqueName: \"kubernetes.io/projected/d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba-kube-api-access-2bw4j\") pod \"authorino-operator-657f44b778-fxw92\" (UID: \"d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba\") " pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:52.736418 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.736360    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bw4j\" (UniqueName: \"kubernetes.io/projected/d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba-kube-api-access-2bw4j\") pod \"authorino-operator-657f44b778-fxw92\" (UID: \"d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba\") " pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:52.748488 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.748456    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bw4j\" (UniqueName: \"kubernetes.io/projected/d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba-kube-api-access-2bw4j\") pod \"authorino-operator-657f44b778-fxw92\" (UID: \"d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba\") " pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:52.843432 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.843324    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:52.989387 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:52.989350    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-fxw92"]
Jun 03 08:55:52.992729 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:55:52.992704    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d5ff47_0ed4_4abf_a397_1c7c2fd7edba.slice/crio-6c864753901e229a1d2d0bff786d31ee329424245b39c219c7a3a075e88f0e22 WatchSource:0}: Error finding container 6c864753901e229a1d2d0bff786d31ee329424245b39c219c7a3a075e88f0e22: Status 404 returned error can't find the container with id 6c864753901e229a1d2d0bff786d31ee329424245b39c219c7a3a075e88f0e22
Jun 03 08:55:53.783797 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:53.783731    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-fxw92" event={"ID":"d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba","Type":"ContainerStarted","Data":"6c864753901e229a1d2d0bff786d31ee329424245b39c219c7a3a075e88f0e22"}
Jun 03 08:55:55.792054 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:55.792019    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-fxw92" event={"ID":"d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba","Type":"ContainerStarted","Data":"de6c215ba035a6988bdaeee9e0aec86401d1a35894b2776e73407e7a73c853ae"}
Jun 03 08:55:55.792434 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:55.792116    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:55:55.812354 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:55:55.812302    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-fxw92" podStartSLOduration=1.723168366 podStartE2EDuration="3.812287148s" podCreationTimestamp="2026-06-03 08:55:52 +0000 UTC" firstStartedPulling="2026-06-03 08:55:52.994661077 +0000 UTC m=+715.027665210" lastFinishedPulling="2026-06-03 08:55:55.083779843 +0000 UTC m=+717.116783992" observedRunningTime="2026-06-03 08:55:55.812087597 +0000 UTC m=+717.845091754" watchObservedRunningTime="2026-06-03 08:55:55.812287148 +0000 UTC m=+717.845291303"
Jun 03 08:56:06.797501 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:06.797467    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-fxw92"
Jun 03 08:56:09.121910 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.121850    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"]
Jun 03 08:56:09.128152 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.128130    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:09.130646 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.130624    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g7s59\""
Jun 03 08:56:09.139744 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.139725    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"]
Jun 03 08:56:09.190760 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.190727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxzh\" (UniqueName: \"kubernetes.io/projected/924d724f-94ce-4c8b-809b-164da6e54500-kube-api-access-hjxzh\") pod \"limitador-operator-controller-manager-85c4996f8c-kfg94\" (UID: \"924d724f-94ce-4c8b-809b-164da6e54500\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:09.291602 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.291555    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxzh\" (UniqueName: \"kubernetes.io/projected/924d724f-94ce-4c8b-809b-164da6e54500-kube-api-access-hjxzh\") pod \"limitador-operator-controller-manager-85c4996f8c-kfg94\" (UID: \"924d724f-94ce-4c8b-809b-164da6e54500\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:09.306904 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.306881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxzh\" (UniqueName: \"kubernetes.io/projected/924d724f-94ce-4c8b-809b-164da6e54500-kube-api-access-hjxzh\") pod \"limitador-operator-controller-manager-85c4996f8c-kfg94\" (UID: \"924d724f-94ce-4c8b-809b-164da6e54500\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:09.440315 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.440231    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:09.578149 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.578074    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"]
Jun 03 08:56:09.581022 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:56:09.580993    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924d724f_94ce_4c8b_809b_164da6e54500.slice/crio-2a55bd8406c712609cd3faf5a81817c1723efde0eb1ab0c4f060ef0f26e94f56 WatchSource:0}: Error finding container 2a55bd8406c712609cd3faf5a81817c1723efde0eb1ab0c4f060ef0f26e94f56: Status 404 returned error can't find the container with id 2a55bd8406c712609cd3faf5a81817c1723efde0eb1ab0c4f060ef0f26e94f56
Jun 03 08:56:09.858248 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:09.858212    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94" event={"ID":"924d724f-94ce-4c8b-809b-164da6e54500","Type":"ContainerStarted","Data":"2a55bd8406c712609cd3faf5a81817c1723efde0eb1ab0c4f060ef0f26e94f56"}
Jun 03 08:56:11.868060 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:11.868024    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94" event={"ID":"924d724f-94ce-4c8b-809b-164da6e54500","Type":"ContainerStarted","Data":"6a2675946255c5113ad61d799920e454d983855b81fe233983349299564732c7"}
Jun 03 08:56:11.868530 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:11.868182    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:56:11.888926 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:11.888882    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94" podStartSLOduration=1.441519103 podStartE2EDuration="2.888854049s" podCreationTimestamp="2026-06-03 08:56:09 +0000 UTC" firstStartedPulling="2026-06-03 08:56:09.582936441 +0000 UTC m=+731.615940575" lastFinishedPulling="2026-06-03 08:56:11.030271387 +0000 UTC m=+733.063275521" observedRunningTime="2026-06-03 08:56:11.887235247 +0000 UTC m=+733.920239404" watchObservedRunningTime="2026-06-03 08:56:11.888854049 +0000 UTC m=+733.921858204"
Jun 03 08:56:22.874758 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:56:22.874723    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kfg94"
Jun 03 08:58:14.219442 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.219404    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:14.223138 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.223111    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:14.225720 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.225700    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 08:58:14.225822 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.225724    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l9ccv\""
Jun 03 08:58:14.241026 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.241002    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:14.333724 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.333690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpb8k\" (UniqueName: \"kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k\") pod \"maas-controller-7c8b4ff4df-9gxgt\" (UID: \"d56a7a48-cf07-451c-a703-df38eafc8c90\") " pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:14.403159 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.403125    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669fd45cd5-kxcs8"]
Jun 03 08:58:14.406574 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.406559    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:14.415642 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.415616    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669fd45cd5-kxcs8"]
Jun 03 08:58:14.434637 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.434609    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpb8k\" (UniqueName: \"kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k\") pod \"maas-controller-7c8b4ff4df-9gxgt\" (UID: \"d56a7a48-cf07-451c-a703-df38eafc8c90\") " pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:14.443111 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.443089    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpb8k\" (UniqueName: \"kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k\") pod \"maas-controller-7c8b4ff4df-9gxgt\" (UID: \"d56a7a48-cf07-451c-a703-df38eafc8c90\") " pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:14.533345 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.533321    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:14.535229 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.535211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6nql\" (UniqueName: \"kubernetes.io/projected/281e3d58-dc61-4594-8c25-ae9e6f5b5c75-kube-api-access-r6nql\") pod \"maas-controller-669fd45cd5-kxcs8\" (UID: \"281e3d58-dc61-4594-8c25-ae9e6f5b5c75\") " pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:14.636521 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.636485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6nql\" (UniqueName: \"kubernetes.io/projected/281e3d58-dc61-4594-8c25-ae9e6f5b5c75-kube-api-access-r6nql\") pod \"maas-controller-669fd45cd5-kxcs8\" (UID: \"281e3d58-dc61-4594-8c25-ae9e6f5b5c75\") " pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:14.645360 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.645329    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6nql\" (UniqueName: \"kubernetes.io/projected/281e3d58-dc61-4594-8c25-ae9e6f5b5c75-kube-api-access-r6nql\") pod \"maas-controller-669fd45cd5-kxcs8\" (UID: \"281e3d58-dc61-4594-8c25-ae9e6f5b5c75\") " pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:14.661692 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.661668    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:14.664119 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:58:14.664087    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56a7a48_cf07_451c_a703_df38eafc8c90.slice/crio-f70c1609461cc4b99244e5781b700f34945662afb6873ab15604c5d5bb77db92 WatchSource:0}: Error finding container f70c1609461cc4b99244e5781b700f34945662afb6873ab15604c5d5bb77db92: Status 404 returned error can't find the container with id f70c1609461cc4b99244e5781b700f34945662afb6873ab15604c5d5bb77db92
Jun 03 08:58:14.718237 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.718204    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:14.846800 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:14.846761    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669fd45cd5-kxcs8"]
Jun 03 08:58:14.848579 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:58:14.848556    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281e3d58_dc61_4594_8c25_ae9e6f5b5c75.slice/crio-a0c1a271dc4a2da12a5794dfccb46d71da40a93a3fbe37610e201e0a28ef69ef WatchSource:0}: Error finding container a0c1a271dc4a2da12a5794dfccb46d71da40a93a3fbe37610e201e0a28ef69ef: Status 404 returned error can't find the container with id a0c1a271dc4a2da12a5794dfccb46d71da40a93a3fbe37610e201e0a28ef69ef
Jun 03 08:58:15.316158 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:15.316074    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669fd45cd5-kxcs8" event={"ID":"281e3d58-dc61-4594-8c25-ae9e6f5b5c75","Type":"ContainerStarted","Data":"a0c1a271dc4a2da12a5794dfccb46d71da40a93a3fbe37610e201e0a28ef69ef"}
Jun 03 08:58:15.318646 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:15.318613    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" event={"ID":"d56a7a48-cf07-451c-a703-df38eafc8c90","Type":"ContainerStarted","Data":"f70c1609461cc4b99244e5781b700f34945662afb6873ab15604c5d5bb77db92"}
Jun 03 08:58:18.332207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.332169    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669fd45cd5-kxcs8" event={"ID":"281e3d58-dc61-4594-8c25-ae9e6f5b5c75","Type":"ContainerStarted","Data":"2737866295effb9129d5f2317ecac126687dfcb1cc54847c322930d090fb7c8d"}
Jun 03 08:58:18.332686 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.332242    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:18.333627 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.333604    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" event={"ID":"d56a7a48-cf07-451c-a703-df38eafc8c90","Type":"ContainerStarted","Data":"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"}
Jun 03 08:58:18.333737 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.333722    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:18.363559 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.363509    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-669fd45cd5-kxcs8" podStartSLOduration=1.804294675 podStartE2EDuration="4.363496135s" podCreationTimestamp="2026-06-03 08:58:14 +0000 UTC" firstStartedPulling="2026-06-03 08:58:14.850042804 +0000 UTC m=+856.883046951" lastFinishedPulling="2026-06-03 08:58:17.409244277 +0000 UTC m=+859.442248411" observedRunningTime="2026-06-03 08:58:18.360928612 +0000 UTC m=+860.393932780" watchObservedRunningTime="2026-06-03 08:58:18.363496135 +0000 UTC m=+860.396500476"
Jun 03 08:58:18.382083 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:18.382029    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" podStartSLOduration=1.627098733 podStartE2EDuration="4.382015038s" podCreationTimestamp="2026-06-03 08:58:14 +0000 UTC" firstStartedPulling="2026-06-03 08:58:14.66540907 +0000 UTC m=+856.698413204" lastFinishedPulling="2026-06-03 08:58:17.420325366 +0000 UTC m=+859.453329509" observedRunningTime="2026-06-03 08:58:18.378733045 +0000 UTC m=+860.411737201" watchObservedRunningTime="2026-06-03 08:58:18.382015038 +0000 UTC m=+860.415019194"
Jun 03 08:58:29.346678 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.346647    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669fd45cd5-kxcs8"
Jun 03 08:58:29.347081 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.346709    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:29.404053 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.404023    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:29.404223 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.404203    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" podUID="d56a7a48-cf07-451c-a703-df38eafc8c90" containerName="manager" containerID="cri-o://e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61" gracePeriod=30
Jun 03 08:58:29.652062 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.652039    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:29.782607 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.782567    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpb8k\" (UniqueName: \"kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k\") pod \"d56a7a48-cf07-451c-a703-df38eafc8c90\" (UID: \"d56a7a48-cf07-451c-a703-df38eafc8c90\") "
Jun 03 08:58:29.784778 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.784752    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k" (OuterVolumeSpecName: "kube-api-access-cpb8k") pod "d56a7a48-cf07-451c-a703-df38eafc8c90" (UID: "d56a7a48-cf07-451c-a703-df38eafc8c90"). InnerVolumeSpecName "kube-api-access-cpb8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 08:58:29.884330 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:29.884250    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpb8k\" (UniqueName: \"kubernetes.io/projected/d56a7a48-cf07-451c-a703-df38eafc8c90-kube-api-access-cpb8k\") on node \"ip-10-0-129-83.ec2.internal\" DevicePath \"\""
Jun 03 08:58:30.377466 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.377432    2575 generic.go:358] "Generic (PLEG): container finished" podID="d56a7a48-cf07-451c-a703-df38eafc8c90" containerID="e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61" exitCode=0
Jun 03 08:58:30.377931 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.377492    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt"
Jun 03 08:58:30.377931 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.377523    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" event={"ID":"d56a7a48-cf07-451c-a703-df38eafc8c90","Type":"ContainerDied","Data":"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"}
Jun 03 08:58:30.377931 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.377569    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c8b4ff4df-9gxgt" event={"ID":"d56a7a48-cf07-451c-a703-df38eafc8c90","Type":"ContainerDied","Data":"f70c1609461cc4b99244e5781b700f34945662afb6873ab15604c5d5bb77db92"}
Jun 03 08:58:30.377931 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.377594    2575 scope.go:117] "RemoveContainer" containerID="e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"
Jun 03 08:58:30.386558 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.386542    2575 scope.go:117] "RemoveContainer" containerID="e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"
Jun 03 08:58:30.386883 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:58:30.386839    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61\": container with ID starting with e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61 not found: ID does not exist" containerID="e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"
Jun 03 08:58:30.386952 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.386892    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61"} err="failed to get container status \"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61\": rpc error: code = NotFound desc = could not find container \"e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61\": container with ID starting with e595affa59715638e7b424a34708cdefa69174f2ee3af9953e0548796eb84d61 not found: ID does not exist"
Jun 03 08:58:30.398766 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.398741    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:30.403738 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.403715    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c8b4ff4df-9gxgt"]
Jun 03 08:58:30.493843 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:30.493799    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56a7a48-cf07-451c-a703-df38eafc8c90" path="/var/lib/kubelet/pods/d56a7a48-cf07-451c-a703-df38eafc8c90/volumes"
Jun 03 08:58:51.688019 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.687939    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-57b579bc94-rblwq"]
Jun 03 08:58:51.688479 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.688389    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56a7a48-cf07-451c-a703-df38eafc8c90" containerName="manager"
Jun 03 08:58:51.688479 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.688406    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56a7a48-cf07-451c-a703-df38eafc8c90" containerName="manager"
Jun 03 08:58:51.688568 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.688534    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d56a7a48-cf07-451c-a703-df38eafc8c90" containerName="manager"
Jun 03 08:58:51.693555 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.693536    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:51.698569 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.698551    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 08:58:51.718433 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.718407    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-57b579bc94-rblwq"]
Jun 03 08:58:51.785202 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.785171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:51.785325 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.785298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ndh\" (UniqueName: \"kubernetes.io/projected/20d7ba54-349f-4ca6-abb6-45482b04b758-kube-api-access-r7ndh\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:51.886101 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.886064    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ndh\" (UniqueName: \"kubernetes.io/projected/20d7ba54-349f-4ca6-abb6-45482b04b758-kube-api-access-r7ndh\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:51.886267 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.886167    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:51.886347 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:58:51.886270    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 03 08:58:51.886347 ip-10-0-129-83 kubenswrapper[2575]: E0603 08:58:51.886322    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls podName:20d7ba54-349f-4ca6-abb6-45482b04b758 nodeName:}" failed. No retries permitted until 2026-06-03 08:58:52.386305522 +0000 UTC m=+894.419309660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls") pod "maas-api-57b579bc94-rblwq" (UID: "20d7ba54-349f-4ca6-abb6-45482b04b758") : secret "maas-api-serving-cert" not found
Jun 03 08:58:51.896088 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:51.896062    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ndh\" (UniqueName: \"kubernetes.io/projected/20d7ba54-349f-4ca6-abb6-45482b04b758-kube-api-access-r7ndh\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:52.193076 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.193041    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"]
Jun 03 08:58:52.195816 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.195800    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:52.198462 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.198443    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 08:58:52.198723 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.198708    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lj69j\""
Jun 03 08:58:52.205547 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.205521    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"]
Jun 03 08:58:52.290077 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.290044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngh5k\" (UniqueName: \"kubernetes.io/projected/cb946f3f-e035-4cc5-8fbf-f954bc34731f-kube-api-access-ngh5k\") pod \"payload-processing-58b6c8fdc7-zwkrp\" (UID: \"cb946f3f-e035-4cc5-8fbf-f954bc34731f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:52.391027 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.390993    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngh5k\" (UniqueName: \"kubernetes.io/projected/cb946f3f-e035-4cc5-8fbf-f954bc34731f-kube-api-access-ngh5k\") pod \"payload-processing-58b6c8fdc7-zwkrp\" (UID: \"cb946f3f-e035-4cc5-8fbf-f954bc34731f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:52.391205 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.391131    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:52.393696 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.393659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20d7ba54-349f-4ca6-abb6-45482b04b758-maas-api-tls\") pod \"maas-api-57b579bc94-rblwq\" (UID: \"20d7ba54-349f-4ca6-abb6-45482b04b758\") " pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:52.422406 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.422371    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngh5k\" (UniqueName: \"kubernetes.io/projected/cb946f3f-e035-4cc5-8fbf-f954bc34731f-kube-api-access-ngh5k\") pod \"payload-processing-58b6c8fdc7-zwkrp\" (UID: \"cb946f3f-e035-4cc5-8fbf-f954bc34731f\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:52.507661 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.507628    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:52.626173 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.626145    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:52.645986 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.645960    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"]
Jun 03 08:58:52.647945 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:58:52.647917    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb946f3f_e035_4cc5_8fbf_f954bc34731f.slice/crio-fc0267d12558b23a44609826c30dd5eb27919d1fc822786ac818cad038d561d6 WatchSource:0}: Error finding container fc0267d12558b23a44609826c30dd5eb27919d1fc822786ac818cad038d561d6: Status 404 returned error can't find the container with id fc0267d12558b23a44609826c30dd5eb27919d1fc822786ac818cad038d561d6
Jun 03 08:58:52.649722 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.649705    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 08:58:52.769729 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:52.769705    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-57b579bc94-rblwq"]
Jun 03 08:58:52.772217 ip-10-0-129-83 kubenswrapper[2575]: W0603 08:58:52.772185    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d7ba54_349f_4ca6_abb6_45482b04b758.slice/crio-64b4fa9dfa72c5e7518d9f38fe1c23bd5a7969cbee17d6743b095d11450058a6 WatchSource:0}: Error finding container 64b4fa9dfa72c5e7518d9f38fe1c23bd5a7969cbee17d6743b095d11450058a6: Status 404 returned error can't find the container with id 64b4fa9dfa72c5e7518d9f38fe1c23bd5a7969cbee17d6743b095d11450058a6
Jun 03 08:58:53.466044 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:53.465996    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-57b579bc94-rblwq" event={"ID":"20d7ba54-349f-4ca6-abb6-45482b04b758","Type":"ContainerStarted","Data":"64b4fa9dfa72c5e7518d9f38fe1c23bd5a7969cbee17d6743b095d11450058a6"}
Jun 03 08:58:53.467284 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:53.467255    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp" event={"ID":"cb946f3f-e035-4cc5-8fbf-f954bc34731f","Type":"ContainerStarted","Data":"fc0267d12558b23a44609826c30dd5eb27919d1fc822786ac818cad038d561d6"}
Jun 03 08:58:55.475207 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.475121    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-57b579bc94-rblwq" event={"ID":"20d7ba54-349f-4ca6-abb6-45482b04b758","Type":"ContainerStarted","Data":"6d43d7e5155b7f53e7df05d7616d48835820e7a4f5c282993bcac716022821ca"}
Jun 03 08:58:55.475641 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.475228    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:58:55.476569 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.476545    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp" event={"ID":"cb946f3f-e035-4cc5-8fbf-f954bc34731f","Type":"ContainerStarted","Data":"c75ab8f017829ccdb168b48bb8412fd221505975886bc3a06dbeb742ab99a0d9"}
Jun 03 08:58:55.476678 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.476648    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 08:58:55.563840 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.563786    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-57b579bc94-rblwq" podStartSLOduration=2.179540265 podStartE2EDuration="4.563768709s" podCreationTimestamp="2026-06-03 08:58:51 +0000 UTC" firstStartedPulling="2026-06-03 08:58:52.773574931 +0000 UTC m=+894.806579080" lastFinishedPulling="2026-06-03 08:58:55.157803391 +0000 UTC m=+897.190807524" observedRunningTime="2026-06-03 08:58:55.529058716 +0000 UTC m=+897.562062872" watchObservedRunningTime="2026-06-03 08:58:55.563768709 +0000 UTC m=+897.596772865"
Jun 03 08:58:55.564246 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:55.564218    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp" podStartSLOduration=1.056031106 podStartE2EDuration="3.564212056s" podCreationTimestamp="2026-06-03 08:58:52 +0000 UTC" firstStartedPulling="2026-06-03 08:58:52.649893193 +0000 UTC m=+894.682897327" lastFinishedPulling="2026-06-03 08:58:55.158074143 +0000 UTC m=+897.191078277" observedRunningTime="2026-06-03 08:58:55.560825548 +0000 UTC m=+897.593829707" watchObservedRunningTime="2026-06-03 08:58:55.564212056 +0000 UTC m=+897.597216211"
Jun 03 08:58:58.500252 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:58.500228    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:58:58.500584 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:58:58.500228    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 08:59:01.485738 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:59:01.485706    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-57b579bc94-rblwq"
Jun 03 08:59:06.482905 ip-10-0-129-83 kubenswrapper[2575]: I0603 08:59:06.482853    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-zwkrp"
Jun 03 09:00:02.297924 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.297890    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"]
Jun 03 09:00:02.301967 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.301944    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.304241 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.304221    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 09:00:02.304965 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.304944    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rl8m2\""
Jun 03 09:00:02.305077 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.304986    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 09:00:02.305234 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.305204    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 09:00:02.309633 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.309608    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"]
Jun 03 09:00:02.339479 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq47k\" (UniqueName: \"kubernetes.io/projected/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kube-api-access-fq47k\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.339645 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.339645 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.339772 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.339772 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.339772 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.339763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441088 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441057    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441245 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441097    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441245 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441245 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441177    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq47k\" (UniqueName: \"kubernetes.io/projected/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kube-api-access-fq47k\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441245 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441222    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441487 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441275    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441607 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441590    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441697 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441673    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.441734 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.441696    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.443352 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.443331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.443669 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.443652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.448483 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.448460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq47k\" (UniqueName: \"kubernetes.io/projected/03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd-kube-api-access-fq47k\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz\" (UID: \"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.615276 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.615183    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:02.752532 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:02.752508    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"]
Jun 03 09:00:02.754797 ip-10-0-129-83 kubenswrapper[2575]: W0603 09:00:02.754771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ddf8d6_b73c_4e6a_9b29_fa2d70a5dddd.slice/crio-0ef713500210de5787208a8e310bac6b2687c98fa04ec132be3f1494b1a1b611 WatchSource:0}: Error finding container 0ef713500210de5787208a8e310bac6b2687c98fa04ec132be3f1494b1a1b611: Status 404 returned error can't find the container with id 0ef713500210de5787208a8e310bac6b2687c98fa04ec132be3f1494b1a1b611
Jun 03 09:00:03.734359 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:03.734318    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz" event={"ID":"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd","Type":"ContainerStarted","Data":"0ef713500210de5787208a8e310bac6b2687c98fa04ec132be3f1494b1a1b611"}
Jun 03 09:00:07.753184 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:07.753148    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz" event={"ID":"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd","Type":"ContainerStarted","Data":"ef05452d4ef76ec0195b8aff7652e3f4380f39255e308e93cb789dcb898cc74a"}
Jun 03 09:00:09.762244 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:09.762207    2575 generic.go:358] "Generic (PLEG): container finished" podID="03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd" containerID="ef05452d4ef76ec0195b8aff7652e3f4380f39255e308e93cb789dcb898cc74a" exitCode=0
Jun 03 09:00:09.762712 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:09.762261    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz" event={"ID":"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd","Type":"ContainerDied","Data":"ef05452d4ef76ec0195b8aff7652e3f4380f39255e308e93cb789dcb898cc74a"}
Jun 03 09:00:12.907130 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:12.907094    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"]
Jun 03 09:00:12.911839 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:12.911816    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:12.914989 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:12.914967    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 09:00:12.927592 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:12.927564    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"]
Jun 03 09:00:13.042665 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.042829 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.042829 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhw5g\" (UniqueName: \"kubernetes.io/projected/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kube-api-access-vhw5g\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.042969 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.042969 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.043054 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.042979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e0251c3-202e-4bc9-a315-da3b0ace28ce-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.143804 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.143763    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144021 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.143821    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144021 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.143888    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e0251c3-202e-4bc9-a315-da3b0ace28ce-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144021 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.143947    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144190 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.144078    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144190 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.144129    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhw5g\" (UniqueName: \"kubernetes.io/projected/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kube-api-access-vhw5g\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144318 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.144288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144374 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.144296    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.144433 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.144394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.146338 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.146309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e0251c3-202e-4bc9-a315-da3b0ace28ce-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.147034 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.147012    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e0251c3-202e-4bc9-a315-da3b0ace28ce-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.151590 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.151567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhw5g\" (UniqueName: \"kubernetes.io/projected/9e0251c3-202e-4bc9-a315-da3b0ace28ce-kube-api-access-vhw5g\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9\" (UID: \"9e0251c3-202e-4bc9-a315-da3b0ace28ce\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.222178 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.222093    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:13.357812 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.357750    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"]
Jun 03 09:00:13.360633 ip-10-0-129-83 kubenswrapper[2575]: W0603 09:00:13.360605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0251c3_202e_4bc9_a315_da3b0ace28ce.slice/crio-e7f16d509ad9e9f7480e0425420a2eb47cdf4f3302d094e29f5ea3d82e3911d5 WatchSource:0}: Error finding container e7f16d509ad9e9f7480e0425420a2eb47cdf4f3302d094e29f5ea3d82e3911d5: Status 404 returned error can't find the container with id e7f16d509ad9e9f7480e0425420a2eb47cdf4f3302d094e29f5ea3d82e3911d5
Jun 03 09:00:13.778136 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.778101    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9" event={"ID":"9e0251c3-202e-4bc9-a315-da3b0ace28ce","Type":"ContainerStarted","Data":"093f0028d78934fbe40d9b4f0613115659047b9eafa40f4106593e65759ef735"}
Jun 03 09:00:13.778136 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:13.778140    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9" event={"ID":"9e0251c3-202e-4bc9-a315-da3b0ace28ce","Type":"ContainerStarted","Data":"e7f16d509ad9e9f7480e0425420a2eb47cdf4f3302d094e29f5ea3d82e3911d5"}
Jun 03 09:00:14.783513 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:14.783480    2575 generic.go:358] "Generic (PLEG): container finished" podID="9e0251c3-202e-4bc9-a315-da3b0ace28ce" containerID="093f0028d78934fbe40d9b4f0613115659047b9eafa40f4106593e65759ef735" exitCode=0
Jun 03 09:00:14.783899 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:14.783562    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9" event={"ID":"9e0251c3-202e-4bc9-a315-da3b0ace28ce","Type":"ContainerDied","Data":"093f0028d78934fbe40d9b4f0613115659047b9eafa40f4106593e65759ef735"}
Jun 03 09:00:30.851507 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:30.851467    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9" event={"ID":"9e0251c3-202e-4bc9-a315-da3b0ace28ce","Type":"ContainerStarted","Data":"f4f8c4c5a029414d007ec75c03fb3c7c64ba22e75daa3c74ba9d9aa80c807e68"}
Jun 03 09:00:30.872484 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:30.872434    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9" podStartSLOduration=3.341282444 podStartE2EDuration="18.872420881s" podCreationTimestamp="2026-06-03 09:00:12 +0000 UTC" firstStartedPulling="2026-06-03 09:00:14.784102922 +0000 UTC m=+976.817107057" lastFinishedPulling="2026-06-03 09:00:30.31524136 +0000 UTC m=+992.348245494" observedRunningTime="2026-06-03 09:00:30.870431476 +0000 UTC m=+992.903435673" watchObservedRunningTime="2026-06-03 09:00:30.872420881 +0000 UTC m=+992.905425034"
Jun 03 09:00:33.223287 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.223249    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:33.223287 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.223294    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:33.235844 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.235817    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:33.863908 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.863845    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz" event={"ID":"03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd","Type":"ContainerStarted","Data":"735016f11160eefd2d7ae5339933325a3cfd9959c47a3310431390375ecc48de"}
Jun 03 09:00:33.875420 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.875393    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9"
Jun 03 09:00:33.885832 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:33.885779    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz" podStartSLOduration=1.622706785 podStartE2EDuration="31.885763796s" podCreationTimestamp="2026-06-03 09:00:02 +0000 UTC" firstStartedPulling="2026-06-03 09:00:02.757042711 +0000 UTC m=+964.790046845" lastFinishedPulling="2026-06-03 09:00:33.020099719 +0000 UTC m=+995.053103856" observedRunningTime="2026-06-03 09:00:33.884899004 +0000 UTC m=+995.917903159" watchObservedRunningTime="2026-06-03 09:00:33.885763796 +0000 UTC m=+995.918767954"
Jun 03 09:00:42.616096 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:42.616059    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:42.616096 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:42.616106    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:42.629248 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:42.629219    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:42.907833 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:42.907742    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz"
Jun 03 09:00:58.111100 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.111061    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"]
Jun 03 09:00:58.117847 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.117819    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.120324 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.120296    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 03 09:00:58.124876 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.124830    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"]
Jun 03 09:00:58.192249 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7s9c\" (UniqueName: \"kubernetes.io/projected/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kube-api-access-j7s9c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.192415 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.192415 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.192415 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.192415 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.192596 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.192424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293330 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293292    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7s9c\" (UniqueName: \"kubernetes.io/projected/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kube-api-access-j7s9c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293506 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293364    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293573 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293531    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293630 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293567    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293630 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293617    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.293732 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.293682    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.294071 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.294016    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.294071 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.294051    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.294304 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.294168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.296484 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.296413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.296762 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.296741    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.301691 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.301668    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7s9c\" (UniqueName: \"kubernetes.io/projected/303ac6e6-a0bf-4f72-b267-aaa6b3677f86-kube-api-access-j7s9c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9\" (UID: \"303ac6e6-a0bf-4f72-b267-aaa6b3677f86\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.434305 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.434211    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"
Jun 03 09:00:58.571624 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.571599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9"]
Jun 03 09:00:58.573840 ip-10-0-129-83 kubenswrapper[2575]: W0603 09:00:58.573809    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303ac6e6_a0bf_4f72_b267_aaa6b3677f86.slice/crio-b258c7ec576abc1b6f4e93e828b0a3541875f851b8f3b822587a7bb205fe7d69 WatchSource:0}: Error finding container b258c7ec576abc1b6f4e93e828b0a3541875f851b8f3b822587a7bb205fe7d69: Status 404 returned error can't find the container with id b258c7ec576abc1b6f4e93e828b0a3541875f851b8f3b822587a7bb205fe7d69
Jun 03 09:00:58.964665 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.964627    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9" event={"ID":"303ac6e6-a0bf-4f72-b267-aaa6b3677f86","Type":"ContainerStarted","Data":"1c397d10059abc113a7402419bd5a6dbf6d747f10bf383d37d05952f0fb84d9d"}
Jun 03 09:00:58.964665 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:00:58.964668    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9" event={"ID":"303ac6e6-a0bf-4f72-b267-aaa6b3677f86","Type":"ContainerStarted","Data":"b258c7ec576abc1b6f4e93e828b0a3541875f851b8f3b822587a7bb205fe7d69"}
Jun 03 09:03:58.530233 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:03:58.530193    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 09:03:58.530892 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:03:58.530873    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 09:06:39.355044 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:39.355018    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9_303ac6e6-a0bf-4f72-b267-aaa6b3677f86/storage-initializer/0.log"
Jun 03 09:06:45.554209 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:45.554177    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c68945bf9-zrjhd_c7937d31-264a-4931-a1b0-733206b66827/nginx/0.log"
Jun 03 09:06:45.671194 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:45.671166    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-jd72j_3258e9cf-6920-4df5-9be3-9630e409eae1/manager/0.log"
Jun 03 09:06:45.797039 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:45.797011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wlnfl_f3d8203e-bc1e-464b-89a6-0928e7008e5e/manager/0.log"
Jun 03 09:06:45.930094 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:45.930025    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-57b579bc94-rblwq_20d7ba54-349f-4ca6-abb6-45482b04b758/maas-api/0.log"
Jun 03 09:06:46.055186 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:46.055160    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669fd45cd5-kxcs8_281e3d58-dc61-4594-8c25-ae9e6f5b5c75/manager/0.log"
Jun 03 09:06:46.776769 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:46.776737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-gwkjq_14e505c9-13fc-4b74-996e-4877cfeac861/copy-manifests/0.log"
Jun 03 09:06:46.783834 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:46.783813    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-gwkjq_14e505c9-13fc-4b74-996e-4877cfeac861/manager/0.log"
Jun 03 09:06:49.567965 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:49.567933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-fxw92_d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba/manager/0.log"
Jun 03 09:06:50.372019 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:50.371992    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kfg94_924d724f-94ce-4c8b-809b-164da6e54500/manager/0.log"
Jun 03 09:06:50.780604 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:50.780574    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb_b97c1ab2-0417-422e-a80d-22f7e311a355/istio-proxy/0.log"
Jun 03 09:06:50.913438 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:50.913407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-sqlx6_4aee9d71-f905-4e75-acb0-36fa57604985/discovery/0.log"
Jun 03 09:06:51.040759 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:51.040685    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b4fd57c-p7dgr_a1298e6e-baa9-4fa9-9842-bc4e4e2b8283/kube-auth-proxy/0.log"
Jun 03 09:06:51.428010 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:51.427937    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-zwkrp_cb946f3f-e035-4cc5-8fbf-f954bc34731f/payload-processing/0.log"
Jun 03 09:06:51.556464 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:51.556438    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6987c77775-l82z4_2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2/router/0.log"
Jun 03 09:06:51.936677 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:51.936645    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz_03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd/main/0.log"
Jun 03 09:06:51.943600 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:51.943577    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-wr5qz_03ddf8d6-b73c-4e6a-9b29-fa2d70a5dddd/storage-initializer/0.log"
Jun 03 09:06:52.219753 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:52.219678    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9_9e0251c3-202e-4bc9-a315-da3b0ace28ce/storage-initializer/0.log"
Jun 03 09:06:52.228036 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:52.228008    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rqtp9_9e0251c3-202e-4bc9-a315-da3b0ace28ce/main/0.log"
Jun 03 09:06:52.630480 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:06:52.630442    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-zvvz9_303ac6e6-a0bf-4f72-b267-aaa6b3677f86/storage-initializer/0.log"
Jun 03 09:07:00.683451 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:00.683411    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z7rkh_2fa95dda-2a17-4a40-8b29-9458e6987dae/global-pull-secret-syncer/0.log"
Jun 03 09:07:00.741594 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:00.741558    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4d259_1619303c-d8ae-475f-bd0b-dbc8fba9d254/konnectivity-agent/0.log"
Jun 03 09:07:00.871069 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:00.871044    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-83.ec2.internal_0de778e07c4a737a6827196a122b0f05/haproxy/0.log"
Jun 03 09:07:05.564819 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:05.564793    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-fxw92_d8d5ff47-0ed4-4abf-a397-1c7c2fd7edba/manager/0.log"
Jun 03 09:07:05.778577 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:05.778544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kfg94_924d724f-94ce-4c8b-809b-164da6e54500/manager/0.log"
Jun 03 09:07:07.215839 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.215810    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/alertmanager/0.log"
Jun 03 09:07:07.236230 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.236204    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/config-reloader/0.log"
Jun 03 09:07:07.256804 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.256781    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/kube-rbac-proxy-web/0.log"
Jun 03 09:07:07.278506 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.278482    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/kube-rbac-proxy/0.log"
Jun 03 09:07:07.312095 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.312067    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/kube-rbac-proxy-metric/0.log"
Jun 03 09:07:07.337020 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.336942    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/prom-label-proxy/0.log"
Jun 03 09:07:07.358231 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.358198    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b941492-c709-4f9f-96b4-dfc503c185de/init-config-reloader/0.log"
Jun 03 09:07:07.392332 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.392305    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-jbkt2_f4ade86b-17a9-46b2-857e-df00545095bf/cluster-monitoring-operator/0.log"
Jun 03 09:07:07.481169 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.481143    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d9b474b59-hm2z6_3e95c5fa-74cb-43e7-bc8d-468237bc6d05/metrics-server/0.log"
Jun 03 09:07:07.606529 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.606453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzpm5_25ad73a8-78de-4b99-b8f7-abe92b277695/node-exporter/0.log"
Jun 03 09:07:07.633452 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.633427    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzpm5_25ad73a8-78de-4b99-b8f7-abe92b277695/kube-rbac-proxy/0.log"
Jun 03 09:07:07.677308 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.677282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzpm5_25ad73a8-78de-4b99-b8f7-abe92b277695/init-textfile/0.log"
Jun 03 09:07:07.787636 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.787604    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-qlf7f_d727496a-5225-47a9-8125-a9beabfe445e/kube-rbac-proxy-main/0.log"
Jun 03 09:07:07.813836 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.813812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-qlf7f_d727496a-5225-47a9-8125-a9beabfe445e/kube-rbac-proxy-self/0.log"
Jun 03 09:07:07.836542 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.836516    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-qlf7f_d727496a-5225-47a9-8125-a9beabfe445e/openshift-state-metrics/0.log"
Jun 03 09:07:07.878236 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.878157    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/prometheus/0.log"
Jun 03 09:07:07.900124 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.900087    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/config-reloader/0.log"
Jun 03 09:07:07.919971 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.919950    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/thanos-sidecar/0.log"
Jun 03 09:07:07.945833 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.945810    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/kube-rbac-proxy-web/0.log"
Jun 03 09:07:07.971630 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.971606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/kube-rbac-proxy/0.log"
Jun 03 09:07:07.999263 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:07.999241    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/kube-rbac-proxy-thanos/0.log"
Jun 03 09:07:08.022552 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.022532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d4c3983e-f377-4762-8776-51426142cea1/init-config-reloader/0.log"
Jun 03 09:07:08.052390 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.052367    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jr5cs_d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba/prometheus-operator/0.log"
Jun 03 09:07:08.076996 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.076960    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jr5cs_d67ef875-8c6f-4f7d-9d02-9596a7c8c2ba/kube-rbac-proxy/0.log"
Jun 03 09:07:08.104574 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.104554    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-cgdgj_02aab70c-8953-4a9c-ae57-cc785e76f163/prometheus-operator-admission-webhook/0.log"
Jun 03 09:07:08.135039 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.134968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6548d5d997-h5bx6_a44f7802-e817-477b-b502-6c351b344934/telemeter-client/0.log"
Jun 03 09:07:08.164141 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.164113    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6548d5d997-h5bx6_a44f7802-e817-477b-b502-6c351b344934/reload/0.log"
Jun 03 09:07:08.193547 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.193521    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6548d5d997-h5bx6_a44f7802-e817-477b-b502-6c351b344934/kube-rbac-proxy/0.log"
Jun 03 09:07:08.235840 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.235815    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/thanos-query/0.log"
Jun 03 09:07:08.263742 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.263719    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/kube-rbac-proxy-web/0.log"
Jun 03 09:07:08.316407 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.316380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/kube-rbac-proxy/0.log"
Jun 03 09:07:08.371377 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.371347    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/prom-label-proxy/0.log"
Jun 03 09:07:08.409432 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.409362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/kube-rbac-proxy-rules/0.log"
Jun 03 09:07:08.439287 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:08.439256    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695cd667d6-sqx7r_79f37d18-4c67-4b6f-aba8-63e2714d7bef/kube-rbac-proxy-metrics/0.log"
Jun 03 09:07:09.946485 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.946453    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"]
Jun 03 09:07:09.950369 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.950348    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:09.953059 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.953032    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wkfg\"/\"default-dockercfg-2x4qf\""
Jun 03 09:07:09.953164 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.953036    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wkfg\"/\"kube-root-ca.crt\""
Jun 03 09:07:09.953651 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.953633    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wkfg\"/\"openshift-service-ca.crt\""
Jun 03 09:07:09.961130 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:09.961104    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"]
Jun 03 09:07:10.116097 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.116049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-sys\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.116340 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.116159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-lib-modules\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.116340 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.116211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-proc\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.116340 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.116247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b489v\" (UniqueName: \"kubernetes.io/projected/719cfdc0-e64c-4d04-82b3-8d66798218db-kube-api-access-b489v\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.116340 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.116311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-podres\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217553 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217465    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-sys\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217701 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217551    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-lib-modules\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217701 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-sys\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217701 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217613    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-proc\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217701 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217654    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b489v\" (UniqueName: \"kubernetes.io/projected/719cfdc0-e64c-4d04-82b3-8d66798218db-kube-api-access-b489v\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217701 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217690    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-podres\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217903 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217730    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-lib-modules\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217903 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217734    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-proc\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.217903 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.217834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/719cfdc0-e64c-4d04-82b3-8d66798218db-podres\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.225761 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.225731    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b489v\" (UniqueName: \"kubernetes.io/projected/719cfdc0-e64c-4d04-82b3-8d66798218db-kube-api-access-b489v\") pod \"perf-node-gather-daemonset-tmrd7\" (UID: \"719cfdc0-e64c-4d04-82b3-8d66798218db\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.261748 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.261718    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:10.398304 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.398277    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"]
Jun 03 09:07:10.400535 ip-10-0-129-83 kubenswrapper[2575]: W0603 09:07:10.400509    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod719cfdc0_e64c_4d04_82b3_8d66798218db.slice/crio-54bd6a8191e317c7e456d9d783a4f5710dd12cdc4fe70ffce6b29e77cab587a3 WatchSource:0}: Error finding container 54bd6a8191e317c7e456d9d783a4f5710dd12cdc4fe70ffce6b29e77cab587a3: Status 404 returned error can't find the container with id 54bd6a8191e317c7e456d9d783a4f5710dd12cdc4fe70ffce6b29e77cab587a3
Jun 03 09:07:10.402150 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:10.402128    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 09:07:11.389998 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.389961    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7" event={"ID":"719cfdc0-e64c-4d04-82b3-8d66798218db","Type":"ContainerStarted","Data":"d417913853400a8db373bffbe4149955772dcfc5dd84247e7111eb3975238fc8"}
Jun 03 09:07:11.389998 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.390003    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7" event={"ID":"719cfdc0-e64c-4d04-82b3-8d66798218db","Type":"ContainerStarted","Data":"54bd6a8191e317c7e456d9d783a4f5710dd12cdc4fe70ffce6b29e77cab587a3"}
Jun 03 09:07:11.390536 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.390047    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:11.409412 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.409354    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7" podStartSLOduration=2.4093367150000002 podStartE2EDuration="2.409336715s" podCreationTimestamp="2026-06-03 09:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:07:11.407937123 +0000 UTC m=+1393.440941282" watchObservedRunningTime="2026-06-03 09:07:11.409336715 +0000 UTC m=+1393.442340886"
Jun 03 09:07:11.935123 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.935095    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhkgt_4fd0c475-094f-4eb5-9d90-f7f07f993d15/dns/0.log"
Jun 03 09:07:11.956435 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:11.956407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhkgt_4fd0c475-094f-4eb5-9d90-f7f07f993d15/kube-rbac-proxy/0.log"
Jun 03 09:07:12.016809 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:12.016779    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwhvr_9ea1b578-ff80-4bcd-8375-6e8c67d9ad28/dns-node-resolver/0.log"
Jun 03 09:07:12.637534 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:12.637506    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-twc8b_38ac16e4-5309-402e-98c3-d5dc027a90f1/node-ca/0.log"
Jun 03 09:07:13.500519 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:13.500487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bpb5nb_b97c1ab2-0417-422e-a80d-22f7e311a355/istio-proxy/0.log"
Jun 03 09:07:13.564116 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:13.564088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-sqlx6_4aee9d71-f905-4e75-acb0-36fa57604985/discovery/0.log"
Jun 03 09:07:13.583918 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:13.583892    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b4fd57c-p7dgr_a1298e6e-baa9-4fa9-9842-bc4e4e2b8283/kube-auth-proxy/0.log"
Jun 03 09:07:13.658190 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:13.658165    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-zwkrp_cb946f3f-e035-4cc5-8fbf-f954bc34731f/payload-processing/0.log"
Jun 03 09:07:13.682063 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:13.682031    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6987c77775-l82z4_2ab52fb0-f868-4f7f-a7bf-c4bbfb59dbc2/router/0.log"
Jun 03 09:07:14.220568 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:14.220543    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mgbrr_061cff9f-34d0-44f5-9cd1-0f7da0c66157/serve-healthcheck-canary/0.log"
Jun 03 09:07:14.777130 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:14.777103    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxx7p_81c9ecdf-8be3-485f-b75c-6fb59c9b3c45/kube-rbac-proxy/0.log"
Jun 03 09:07:14.799260 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:14.799234    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxx7p_81c9ecdf-8be3-485f-b75c-6fb59c9b3c45/exporter/0.log"
Jun 03 09:07:14.822122 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:14.822095    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxx7p_81c9ecdf-8be3-485f-b75c-6fb59c9b3c45/extractor/0.log"
Jun 03 09:07:16.953149 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:16.953105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c68945bf9-zrjhd_c7937d31-264a-4931-a1b0-733206b66827/nginx/0.log"
Jun 03 09:07:16.985162 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:16.985135    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-jd72j_3258e9cf-6920-4df5-9be3-9630e409eae1/manager/0.log"
Jun 03 09:07:17.023474 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.023438    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wlnfl_f3d8203e-bc1e-464b-89a6-0928e7008e5e/manager/0.log"
Jun 03 09:07:17.046874 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.046814    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-57b579bc94-rblwq_20d7ba54-349f-4ca6-abb6-45482b04b758/maas-api/0.log"
Jun 03 09:07:17.080060 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.080030    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669fd45cd5-kxcs8_281e3d58-dc61-4594-8c25-ae9e6f5b5c75/manager/0.log"
Jun 03 09:07:17.354109 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.354078    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-gwkjq_14e505c9-13fc-4b74-996e-4877cfeac861/manager/0.log"
Jun 03 09:07:17.375993 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.375965    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-gwkjq_14e505c9-13fc-4b74-996e-4877cfeac861/copy-manifests/0.log"
Jun 03 09:07:17.404317 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:17.404295    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-tmrd7"
Jun 03 09:07:23.905269 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:23.905227    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-f5jtg_d2626064-f336-440e-b5fa-f8a72355afdf/kube-storage-version-migrator-operator/1.log"
Jun 03 09:07:23.906155 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:23.906136    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-f5jtg_d2626064-f336-440e-b5fa-f8a72355afdf/kube-storage-version-migrator-operator/0.log"
Jun 03 09:07:24.923112 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:24.923087    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7j2zm_0cd087ea-c233-45e2-8060-54ace9000fa9/kube-multus/0.log"
Jun 03 09:07:24.963038 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:24.963009    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/kube-multus-additional-cni-plugins/0.log"
Jun 03 09:07:24.986714 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:24.986690    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/egress-router-binary-copy/0.log"
Jun 03 09:07:25.012368 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.012345    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/cni-plugins/0.log"
Jun 03 09:07:25.038597 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.038574    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/bond-cni-plugin/0.log"
Jun 03 09:07:25.074680 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.074657    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/routeoverride-cni/0.log"
Jun 03 09:07:25.102197 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.102172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/whereabouts-cni-bincopy/0.log"
Jun 03 09:07:25.124485 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.124457    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b6ws_2b5b960c-20ac-4652-bd3d-6cac49b2a58a/whereabouts-cni/0.log"
Jun 03 09:07:25.675909 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.675877    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vgxx_63b283ff-0575-4c05-9717-ce0ec5f2dbc1/network-metrics-daemon/0.log"
Jun 03 09:07:25.712583 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:25.712553    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vgxx_63b283ff-0575-4c05-9717-ce0ec5f2dbc1/kube-rbac-proxy/0.log"
Jun 03 09:07:27.298605 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.298575    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-controller/0.log"
Jun 03 09:07:27.316662 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.316636    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/0.log"
Jun 03 09:07:27.323037 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.323017    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovn-acl-logging/1.log"
Jun 03 09:07:27.344043 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.344022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/kube-rbac-proxy-node/0.log"
Jun 03 09:07:27.365058 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.365036    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 09:07:27.385301 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.385281    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/northd/0.log"
Jun 03 09:07:27.405751 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.405728    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/nbdb/0.log"
Jun 03 09:07:27.426033 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.426009    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/sbdb/0.log"
Jun 03 09:07:27.517328 ip-10-0-129-83 kubenswrapper[2575]: I0603 09:07:27.517297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qwmxm_61adc58a-6601-40ea-8a45-80aae27478ce/ovnkube-controller/0.log"