Jun 02 01:48:12.230798 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 02 01:48:12.230808 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 02 01:48:12.230815 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 02 01:48:12.231028 ip-10-0-138-87 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 02 01:48:22.266210 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 02 01:48:22.266228 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9bb383a4234a49829a063eb73d14a503 --
Jun 02 01:50:40.527482 ip-10-0-138-87 systemd[1]: Starting Kubernetes Kubelet...
Jun 02 01:50:40.998206 ip-10-0-138-87 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:50:40.998206 ip-10-0-138-87 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 02 01:50:40.998206 ip-10-0-138-87 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:50:40.998206 ip-10-0-138-87 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 02 01:50:40.998206 ip-10-0-138-87 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 02 01:50:41.000954 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.000863    2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 02 01:50:41.003622 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003604    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:50:41.003622 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003623    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003627    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003630    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003634    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003637    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003640    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003643    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003646    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003649    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003652    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003654    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003657    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003660    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003662    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003665    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003668    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003670    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003673    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003676    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:50:41.003690 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003680    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003682    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003685    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003695    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003698    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003701    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003703    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003706    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003708    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003711    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003714    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003716    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003719    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003722    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003751    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003756    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003759    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003762    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003766    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003769    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:50:41.004136 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003771    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003774    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003777    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003780    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003784    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003787    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003790    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003794    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003796    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003799    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003802    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003804    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003807    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003809    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003814    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003817    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003819    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003822    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003825    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:50:41.004651 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003828    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003832    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003835    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003839    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003842    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003844    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003847    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003849    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003852    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003854    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003857    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003860    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003863    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003865    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003868    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003873    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003875    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003878    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003881    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003883    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:50:41.005104 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003886    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003889    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003891    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003894    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003896    2567 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003899    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.003902    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004317    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004322    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004325    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004328    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004331    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004333    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004336    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004339    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004342    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004344    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004347    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004349    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004352    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:50:41.005600 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004355    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004357    2567 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004360    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004363    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004365    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004368    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004371    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004374    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004378    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004382    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004385    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004388    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004390    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004393    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004395    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004398    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004400    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004402    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004405    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004408    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:50:41.006087 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004411    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004414    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004416    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004419    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004421    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004425    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004428    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004432    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004435    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004438    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004441    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004444    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004448    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004450    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004453    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004455    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004458    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004460    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004463    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:50:41.006589 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004466    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004468    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004471    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004473    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004476    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004479    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004481    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004484    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004486    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004489    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004491    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004494    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004496    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004499    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004502    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004504    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004507    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004509    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004512    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:50:41.007054 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004515    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004518    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004520    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004523    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004526    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004528    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004530    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004533    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004535    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004538    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004541    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004544    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004546    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004548    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.004551    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004623    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004631    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004637    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004642    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004645    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004649    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 02 01:50:41.007550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004653    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004658    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004661    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004665    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004670    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004673    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004677    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004680    2567 flags.go:64] FLAG: --cgroup-root=""
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004682    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004685    2567 flags.go:64] FLAG: --client-ca-file=""
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004688    2567 flags.go:64] FLAG: --cloud-config=""
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004691    2567 flags.go:64] FLAG: --cloud-provider="external"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004694    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004699    2567 flags.go:64] FLAG: --cluster-domain=""
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004702    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004706    2567 flags.go:64] FLAG: --config-dir=""
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004708    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004712    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004716    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004719    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004722    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004725    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004728    2567 flags.go:64] FLAG: --contention-profiling="false"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004731    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 02 01:50:41.008077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004735    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004738    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004741    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004746    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004749    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004753    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004755    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004759    2567 flags.go:64] FLAG: --enable-server="true"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004762    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004766    2567 flags.go:64] FLAG: --event-burst="100"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004769    2567 flags.go:64] FLAG: --event-qps="50"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004773    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004775    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004778    2567 flags.go:64] FLAG: --eviction-hard=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004782    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004785    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004788    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004791    2567 flags.go:64] FLAG: --eviction-soft=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004794    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004797    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004800    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004803    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004805    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004808    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004811    2567 flags.go:64] FLAG: --feature-gates=""
Jun 02 01:50:41.008766 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004815    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004818    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004821    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004824    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004827    2567 flags.go:64] FLAG: --healthz-port="10248"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004830    2567 flags.go:64] FLAG: --help="false"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004833    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004837    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004840    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004843    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004846    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004850    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004853    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004856    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004859    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004862    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004865    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004868    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004871    2567 flags.go:64] FLAG: --kube-reserved=""
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004874    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004877    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004879    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004882    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004885    2567 flags.go:64] FLAG: --lock-file=""
Jun 02 01:50:41.009434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004888    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004891    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004893    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004898    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004901    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004904    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004907    2567 flags.go:64] FLAG: --logging-format="text"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004910    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004913    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004916    2567 flags.go:64] FLAG: --manifest-url=""
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004919    2567 flags.go:64] FLAG: --manifest-url-header=""
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004923    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004926    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004930    2567 flags.go:64] FLAG: --max-pods="110"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004933    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004936    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004939    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004942    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004945    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004948    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004952    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004959    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004962    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004966    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 02 01:50:41.010030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004969    2567 flags.go:64] FLAG: --pod-cidr=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004972    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004978    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004981    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004984    2567 flags.go:64] FLAG: --pods-per-core="0"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004987    2567 flags.go:64] FLAG: --port="10250"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004990    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004993    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077856d4585f840e5"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004996    2567 flags.go:64] FLAG: --qos-reserved=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.004999    2567 flags.go:64] FLAG: --read-only-port="10255"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005002    2567 flags.go:64] FLAG: --register-node="true"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005005    2567 flags.go:64] FLAG: --register-schedulable="true"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005008    2567 flags.go:64] FLAG: --register-with-taints=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005012    2567 flags.go:64] FLAG: --registry-burst="10"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005015    2567 flags.go:64] FLAG: --registry-qps="5"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005017    2567 flags.go:64] FLAG: --reserved-cpus=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005020    2567 flags.go:64] FLAG: --reserved-memory=""
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005024    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005027    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005030    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005033    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005036    2567 flags.go:64] FLAG: --runonce="false"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005039    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005042    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005045    2567 flags.go:64] FLAG: --seccomp-default="false"
Jun 02 01:50:41.010648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005049    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005052    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005055    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005058    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005062    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005065    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005068    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005071    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005073    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005076    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005079    2567 flags.go:64] FLAG: --system-cgroups=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005082    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005088    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005091    2567 flags.go:64] FLAG: --tls-cert-file=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005094    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005098    2567 flags.go:64] FLAG: --tls-min-version=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005101    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005104    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005107    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005110    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005113    2567 flags.go:64] FLAG: --v="2"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005118    2567 flags.go:64] FLAG: --version="false"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005122    2567 flags.go:64] FLAG: --vmodule=""
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005127    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005130    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 02 01:50:41.011675 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005242    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005247    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005251    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005255    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005259    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005262    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005265    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005268    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005271    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005274    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005277    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005280    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005287    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005290    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005292    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005295    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005298    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005300    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005303    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:50:41.012733 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005305    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005308    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005310    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005313    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005316    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005318    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005321    2567 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005323    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005326    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005328    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005331    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005333    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005336    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005340    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005342    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005345    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005347    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005350    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005352    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005355    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:50:41.013313 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005357    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005360    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005363    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005366    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005368    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005372    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005375    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005378    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005380    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005383    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005385    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005388    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005391    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005393    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005396    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005398    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005401    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005404    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005407    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:50:41.013944 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005410    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005412    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005415    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005417    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005420    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005423    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005426    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005429    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005431    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005434    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005436    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005439    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005441    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005444    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005446    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005449    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005451    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005454    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005458    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:50:41.014795 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005461    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005464    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005466    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005469    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005472    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005474    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005477    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005479    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.005481    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.005993    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.013674    2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.013697    2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013775    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013783    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013788    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013793    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:50:41.015343 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013798    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013802    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013814    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013819    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013823    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013831    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013838    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013844    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013849    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013854    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013858    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013863    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013868    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013873    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013877    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013881    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013885    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013890    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013894    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:50:41.015809 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013898    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013902    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013906    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013911    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013915    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013919    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013923    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013927    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013934    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013938    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013943    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013947    2567 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013951    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013955    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013959    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013963    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013967    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013971    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013976    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013980    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:50:41.016543 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013984    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013988    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013993    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.013997    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014002    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014006    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014010    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014014    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014018    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014022    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014027    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014031    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014036    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014040    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014044    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014048    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014053    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014057    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014061    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014065    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:50:41.017099 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014070    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014076    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014081    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014085    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014089    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014096    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014102    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014106    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014110    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014115    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014119    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014123    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014127    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014132    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014136    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014141    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014145    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014149    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014153    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:50:41.017640 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014158    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014162    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014166    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014170    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.014178    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014359    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014368    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014373    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014378    2567 feature_gate.go:328] unrecognized feature gate: Example
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014382    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014387    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014391    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014395    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014400    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014405    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014411    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 02 01:50:41.018598 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014415    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014420    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014424    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014429    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014434    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014440    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014444    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014448    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014452    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014456    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014461    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014466    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014470    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014474    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014479    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014483    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014487    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014491    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014495    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014499    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 02 01:50:41.019003 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014503    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014507    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014511    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014516    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014520    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014524    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014528    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014532    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014536    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014541    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014546    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014550    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014555    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014560    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014564    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014568    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014572    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014576    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014580    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014584    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 02 01:50:41.019653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014588    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014592    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014596    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014601    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014605    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014609    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014613    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014618    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014622    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014626    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014630    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014634    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014638    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014642    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014646    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014650    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014654    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014658    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014662    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014667    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 02 01:50:41.020146 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014671    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014675    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014679    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014684    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014687    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014693    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014699    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014705    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014709    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014714    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014718    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014723    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014727    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014731    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:41.014735    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 02 01:50:41.020740 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.014743    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 02 01:50:41.021111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.015523    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 02 01:50:41.021111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.019135    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 02 01:50:41.021111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.020229    2567 server.go:1019] "Starting client certificate rotation"
Jun 02 01:50:41.021111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.020338    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 01:50:41.021111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.020373    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 02 01:50:41.047040 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.047014    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 01:50:41.048772 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.048753    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 02 01:50:41.064199 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.064177    2567 log.go:25] "Validated CRI v1 runtime API"
Jun 02 01:50:41.070072 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.070051    2567 log.go:25] "Validated CRI v1 image API"
Jun 02 01:50:41.071821 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.071801    2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 02 01:50:41.078431 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.078409    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d6177ca7-d5b7-4be5-a7d3-67903ed704d6:/dev/nvme0n1p3 e54aa8c3-1b35-4a12-8a42-a662f501888d:/dev/nvme0n1p4]
Jun 02 01:50:41.078507 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.078429    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 02 01:50:41.082759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.082647    2567 manager.go:217] Machine: {Timestamp:2026-06-02 01:50:41.082143244 +0000 UTC m=+0.434163004 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099781 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2181918acb4ef086196b8c32192399 SystemUUID:ec218191-8acb-4ef0-8619-6b8c32192399 BootID:9bb383a4-234a-4982-9a06-3eb73d14a503 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:57:3a:49:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:57:3a:49:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:87:c3:5a:db:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 02 01:50:41.082759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.082749    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 02 01:50:41.082893 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.082859    2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 02 01:50:41.084047 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.084030    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 01:50:41.084554 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.084531    2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 02 01:50:41.084687 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.084556    2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 02 01:50:41.085196 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.085186    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jun 02 01:50:41.085242 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.085199    2567 container_manager_linux.go:306] "Creating device plugin manager"
Jun 02 01:50:41.085242 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.085207    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 01:50:41.085242 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.085229    2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 02 01:50:41.086485 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.086475    2567 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 01:50:41.086752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.086742    2567 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 02 01:50:41.089297 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.089287    2567 kubelet.go:491] "Attempting to sync node with API server"
Jun 02 01:50:41.089350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.089301    2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 02 01:50:41.089350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.089318    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 02 01:50:41.089350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.089327    2567 kubelet.go:397] "Adding apiserver pod source"
Jun 02 01:50:41.089350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.089335    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 02 01:50:41.090583 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.090571    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 01:50:41.090624 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.090590    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 02 01:50:41.095826 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.095797    2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 02 01:50:41.098120 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.098072    2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 02 01:50:41.099845 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099810    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099878    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099891    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099901    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099915    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099926    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099934    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 02 01:50:41.099946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099944    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 02 01:50:41.100183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099962    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 02 01:50:41.100183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099984    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 02 01:50:41.100183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.099999    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 02 01:50:41.100183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.100009    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 02 01:50:41.102055 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.102039    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 02 01:50:41.102117 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.102068    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 02 01:50:41.104284 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.104262    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 02 01:50:41.104361 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.104285    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 02 01:50:41.105765 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.105634    2567 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 02 01:50:41.105835 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.105789    2567 server.go:1295] "Started kubelet"
Jun 02 01:50:41.105932 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.105882    2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 02 01:50:41.105965 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.105948    2567 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 02 01:50:41.106554 ip-10-0-138-87 systemd[1]: Started Kubernetes Kubelet.
Jun 02 01:50:41.106656 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.106568    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 02 01:50:41.107089 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.107060    2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 02 01:50:41.107789 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.107778    2567 server.go:317] "Adding debug handlers to kubelet server"
Jun 02 01:50:41.111355 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.111336    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2vt7"
Jun 02 01:50:41.112025 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112010    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 02 01:50:41.112025 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112022    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 02 01:50:41.112134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112083    2567 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 02 01:50:41.112134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112092    2567 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 02 01:50:41.112281 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112267    2567 reconstruct.go:97] "Volume reconstruction finished"
Jun 02 01:50:41.112350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112283    2567 reconciler.go:26] "Reconciler: start to sync state"
Jun 02 01:50:41.112529 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112511    2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 02 01:50:41.112647 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112629    2567 factory.go:55] Registering systemd factory
Jun 02 01:50:41.112706 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.112653    2567 factory.go:223] Registration of the systemd container factory successfully
Jun 02 01:50:41.112842 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.112827    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.113293 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113275    2567 factory.go:153] Registering CRI-O factory
Jun 02 01:50:41.113361 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113296    2567 factory.go:223] Registration of the crio container factory successfully
Jun 02 01:50:41.113430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113362    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 02 01:50:41.113430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113379    2567 factory.go:103] Registering Raw factory
Jun 02 01:50:41.113430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113389    2567 manager.go:1196] Started watching for new ooms in manager
Jun 02 01:50:41.113745 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.113719    2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 02 01:50:41.113846 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113798    2567 manager.go:319] Starting recovery of all containers
Jun 02 01:50:41.113916 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.113900    2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 02 01:50:41.115800 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.113995    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-87.ec2.internal.18b5209275a2017e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-87.ec2.internal,UID:ip-10-0-138-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-87.ec2.internal,},FirstTimestamp:2026-06-02 01:50:41.105764734 +0000 UTC m=+0.457784476,LastTimestamp:2026-06-02 01:50:41.105764734 +0000 UTC m=+0.457784476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-87.ec2.internal,}"
Jun 02 01:50:41.121992 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.121968    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2vt7"
Jun 02 01:50:41.123653 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.123627    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 02 01:50:41.123852 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.123829    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 02 01:50:41.124775 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.124747    2567 manager.go:324] Recovery completed
Jun 02 01:50:41.127900 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.127880    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jun 02 01:50:41.130842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.130829    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.132568 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.132553    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.132621 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.132583    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.132621 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.132596    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.133044 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.133031    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 02 01:50:41.133087 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.133043    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 02 01:50:41.133087 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.133062    2567 state_mem.go:36] "Initialized new in-memory state store"
Jun 02 01:50:41.135046 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.135035    2567 policy_none.go:49] "None policy: Start"
Jun 02 01:50:41.135090 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.135051    2567 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 02 01:50:41.135090 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.135061    2567 state_mem.go:35] "Initializing new in-memory state store"
Jun 02 01:50:41.171791 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.171774    2567 manager.go:341] "Starting Device Plugin manager"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.171851    2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.171863    2567 server.go:85] "Starting device plugin registration server"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.172076    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.172090    2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.172190    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.172279    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.172287    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.172769    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 02 01:50:41.178922 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.172812    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.206154 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.206124    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 02 01:50:41.207340 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.207325    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 02 01:50:41.207404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.207350    2567 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 02 01:50:41.207404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.207373    2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 02 01:50:41.207404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.207382    2567 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 02 01:50:41.207534 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.207429    2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 02 01:50:41.210100 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.210081    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:50:41.272521 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.272466    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.273422 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.273408    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.273489 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.273440    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.273489 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.273452    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.273489 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.273472    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.279910 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.279895    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.279960 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.279918    2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-87.ec2.internal\": node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.304616 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.304590    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.307642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.307627    2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"]
Jun 02 01:50:41.307695 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.307685    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.308450 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.308433    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.308535 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.308464    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.308535 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.308474    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.309536 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.309524    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.309733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.309719    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.309788 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.309750    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.310175 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310159    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.310268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310188    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.310268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310204    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.310268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310253    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.310372 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310272    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.310372 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.310284    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.311331 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.311319    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.311385 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.311343    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 02 01:50:41.313718 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.313701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.313794 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.313748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.313855 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.313790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33a4f9a04dffa76a96184c86815a9643-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"33a4f9a04dffa76a96184c86815a9643\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.314958 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.314932    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory"
Jun 02 01:50:41.315017 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.314971    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure"
Jun 02 01:50:41.315017 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.314985    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID"
Jun 02 01:50:41.330737 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.330719    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.336111 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.336096    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.404848 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.404827    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.414393 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414374    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33a4f9a04dffa76a96184c86815a9643-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"33a4f9a04dffa76a96184c86815a9643\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.414500 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414399    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.414500 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414416    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.414500 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.414500 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414463    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33a4f9a04dffa76a96184c86815a9643-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"33a4f9a04dffa76a96184c86815a9643\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.414500 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.414476    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/291ac5e5e857590426ca5c17a1f85812-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"291ac5e5e857590426ca5c17a1f85812\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.505874 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.505846    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.606697 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.606621    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.633072 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.633043    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.639523 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:41.639509    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:41.707194 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.707163    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.807742 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.807714    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:41.908220 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:41.908193    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.008798 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.008770    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.020229 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.020199    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 02 01:50:42.020400 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.020353    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 02 01:50:42.109811 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.109776    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.112921 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.112908    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 02 01:50:42.118107 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:42.118080    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a4f9a04dffa76a96184c86815a9643.slice/crio-b281b0b1146d0d0e880d8d4a78c383134d12b5f5ef29e8f777bf931a45b1b8a1 WatchSource:0}: Error finding container b281b0b1146d0d0e880d8d4a78c383134d12b5f5ef29e8f777bf931a45b1b8a1: Status 404 returned error can't find the container with id b281b0b1146d0d0e880d8d4a78c383134d12b5f5ef29e8f777bf931a45b1b8a1
Jun 02 01:50:42.118278 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:42.118263    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291ac5e5e857590426ca5c17a1f85812.slice/crio-a9384b888cd43e08d9bdd43ca9264f843895815abb2e29be139aeb64eb3a5530 WatchSource:0}: Error finding container a9384b888cd43e08d9bdd43ca9264f843895815abb2e29be139aeb64eb3a5530: Status 404 returned error can't find the container with id a9384b888cd43e08d9bdd43ca9264f843895815abb2e29be139aeb64eb3a5530
Jun 02 01:50:42.123540 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.123526    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 01:50:42.123853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.123825    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:45:41 +0000 UTC" deadline="2028-03-16 13:02:59.805749704 +0000 UTC"
Jun 02 01:50:42.123853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.123851    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15683h12m17.681901117s"
Jun 02 01:50:42.135083 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.135062    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 02 01:50:42.156000 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.155978    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xq8b4"
Jun 02 01:50:42.166306 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.166260    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xq8b4"
Jun 02 01:50:42.209881 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.209852    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.210701 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.210662    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"33a4f9a04dffa76a96184c86815a9643","Type":"ContainerStarted","Data":"b281b0b1146d0d0e880d8d4a78c383134d12b5f5ef29e8f777bf931a45b1b8a1"}
Jun 02 01:50:42.211538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.211518    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"291ac5e5e857590426ca5c17a1f85812","Type":"ContainerStarted","Data":"a9384b888cd43e08d9bdd43ca9264f843895815abb2e29be139aeb64eb3a5530"}
Jun 02 01:50:42.267126 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.267103    2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:50:42.310374 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.310350    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.330741 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.330718    2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:50:42.411276 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.411248    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.511811 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:42.511782    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found"
Jun 02 01:50:42.609909 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.609851    2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:50:42.612459 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.612438    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:42.622960 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.622937    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 02 01:50:42.623984 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.623965    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal"
Jun 02 01:50:42.632896 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.632875    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 02 01:50:42.972204 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:42.972172    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 02 01:50:43.091535 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.091503    2567 apiserver.go:52] "Watching apiserver"
Jun 02 01:50:43.097752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.097727    2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 02 01:50:43.098098 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.098071    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5lzzb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-6z464","openshift-multus/network-metrics-daemon-495wn","openshift-network-diagnostics/network-check-target-qsfsw","openshift-ovn-kubernetes/ovnkube-node-qzsbw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww","openshift-cluster-node-tuning-operator/tuned-5gqzz","openshift-dns/node-resolver-lhz4g","openshift-multus/multus-mhw7h","openshift-network-operator/iptables-alerter-bvxmc","kube-system/konnectivity-agent-nkfll","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"]
Jun 02 01:50:43.099571 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.099553    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.100584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.100568    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.101569 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.101542    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.101661 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.101619    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:43.102259 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102026    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggtl7\""
Jun 02 01:50:43.102358 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102056    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.102358 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102066    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 02 01:50:43.102772 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102605    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:43.102772 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102673    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.102772 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.102681    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.102772 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.102670    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:43.103197 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.103175    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 02 01:50:43.103301 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.103243    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 02 01:50:43.103357 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.103306    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q74tj\""
Jun 02 01:50:43.104421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.103959    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.104421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.103973    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 02 01:50:43.104421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.104003    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.104995 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.104975    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.106067 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.106048    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.108355 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.108338    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.109786 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.109546    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.110798 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.110780    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.114245 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.111960    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.114245 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.112311    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.114245 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.112434    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.114245 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.112517    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.114483 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.114463    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-59qlj\""
Jun 02 01:50:43.114483 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.114475    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 02 01:50:43.114578 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.114500    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 02 01:50:43.115480 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.114807    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.115480 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.115182    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 02 01:50:43.115480 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.115299    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 02 01:50:43.115685 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.115650    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.115685 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.115670    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 02 01:50:43.116444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.115893    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6x9wh\""
Jun 02 01:50:43.116444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116018    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.116444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116047    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qgc5m\""
Jun 02 01:50:43.116444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116190    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bdlw\""
Jun 02 01:50:43.116444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116389    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.116700 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116392    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 02 01:50:43.116700 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116511    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.116700 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116551    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl5tr\""
Jun 02 01:50:43.116700 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116678    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 02 01:50:43.116872 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116819    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 02 01:50:43.116924 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.116904    2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 02 01:50:43.117209 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.117176    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5wtx\""
Jun 02 01:50:43.117314 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.117235    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-krgjr\""
Jun 02 01:50:43.118596 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.118578    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 02 01:50:43.122602 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.122580    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 02 01:50:43.123370 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-bin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123482 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-daemon-config\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123482 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-multus-certs\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123482 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdpk\" (UniqueName: \"kubernetes.io/projected/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-kube-api-access-cwdpk\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123482 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-socket-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-var-lib-kubelet\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-tuned\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-hostroot\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123548    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123599    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-etc-kubernetes\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.123677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-k8s-cni-cncf-io\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9dj\" (UniqueName: \"kubernetes.io/projected/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kube-api-access-tv9dj\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-kubelet\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123770    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-systemd-units\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-multus\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6kn4\" (UniqueName: \"kubernetes.io/projected/0b7ea8cb-95b7-4640-b843-efe09587073c-kube-api-access-r6kn4\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.123990 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.123982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-netd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-run\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b55cd361-1a12-4c28-bc06-1cfac48cce3f-iptables-alerter-script\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-slash\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22e122d-74a1-4803-8529-6655e2a6abd2-ovn-node-metrics-cert\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124317 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-script-lib\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-host\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55cd361-1a12-4c28-bc06-1cfac48cce3f-host-slash\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fefbcfff-9796-44fe-a176-0e9d272bb56c-konnectivity-ca\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/508a812b-d86e-4f50-a437-b605c2b433ee-serviceca\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-device-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-ovn\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j97f\" (UniqueName: \"kubernetes.io/projected/c22e122d-74a1-4803-8529-6655e2a6abd2-kube-api-access-9j97f\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-node-log\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysconfig\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.124640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-tmp\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-os-release\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-systemd\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-os-release\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cni-binary-copy\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-cnibin\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cnibin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-kubelet\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dth2m\" (UniqueName: \"kubernetes.io/projected/cfb98503-7922-4aa6-b38a-d3df7e87b193-kube-api-access-dth2m\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124924    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-conf-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.124964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-systemd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-config\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdcmx\" (UniqueName: \"kubernetes.io/projected/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-kube-api-access-tdcmx\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862ww\" (UniqueName: \"kubernetes.io/projected/e9386f7d-5f0f-48ab-8378-e577c0d87974-kube-api-access-862ww\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.125146 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/508a812b-d86e-4f50-a437-b605c2b433ee-host\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-socket-dir-parent\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125264    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9tc\" (UniqueName: \"kubernetes.io/projected/b55cd361-1a12-4c28-bc06-1cfac48cce3f-kube-api-access-lj9tc\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fefbcfff-9796-44fe-a176-0e9d272bb56c-agent-certs\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gr4x\" (UniqueName: \"kubernetes.io/projected/508a812b-d86e-4f50-a437-b605c2b433ee-kube-api-access-6gr4x\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125397    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-registration-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-lib-modules\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-hosts-file\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-system-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-sys-fs\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125588    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-netns\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-log-socket\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.125822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-env-overrides\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-sys\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-var-lib-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-etc-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-modprobe-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-conf\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-tmp-dir\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-system-cni-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-netns\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-bin\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.126538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.125956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-kubernetes\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.167539 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.167516    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:42 +0000 UTC" deadline="2028-02-10 23:15:35.590763894 +0000 UTC"
Jun 02 01:50:43.167539 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.167539    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14853h24m52.4232286s"
Jun 02 01:50:43.226261 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226168    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-script-lib\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226261 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226204    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-host\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226281    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-host\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226315    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55cd361-1a12-4c28-bc06-1cfac48cce3f-host-slash\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226338    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fefbcfff-9796-44fe-a176-0e9d272bb56c-konnectivity-ca\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226359    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/508a812b-d86e-4f50-a437-b605c2b433ee-serviceca\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226382    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226403    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-device-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226409    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b55cd361-1a12-4c28-bc06-1cfac48cce3f-host-slash\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226426    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-ovn\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226462    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-ovn\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226468    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j97f\" (UniqueName: \"kubernetes.io/projected/c22e122d-74a1-4803-8529-6655e2a6abd2-kube-api-access-9j97f\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226500    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226530    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-node-log\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226555    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysconfig\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226578    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226602    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-tmp\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226626    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-os-release\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226651    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-systemd\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226675    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-os-release\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226700    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cni-binary-copy\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226719    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysconfig\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226727    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-cnibin\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226751    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cnibin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226765    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-script-lib\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226776    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-kubelet\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226811    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dth2m\" (UniqueName: \"kubernetes.io/projected/cfb98503-7922-4aa6-b38a-d3df7e87b193-kube-api-access-dth2m\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.226881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226849    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-conf-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226874    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-systemd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226886    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226895    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226913    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-config\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226956    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226967    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226979    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdcmx\" (UniqueName: \"kubernetes.io/projected/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-kube-api-access-tdcmx\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.226980    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fefbcfff-9796-44fe-a176-0e9d272bb56c-konnectivity-ca\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227007    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-862ww\" (UniqueName: \"kubernetes.io/projected/e9386f7d-5f0f-48ab-8378-e577c0d87974-kube-api-access-862ww\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227038    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-node-log\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227070    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-os-release\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227073    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-systemd\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-systemd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-conf-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227165    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-cnibin\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227172    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-os-release\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227241    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cnibin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.227666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227279    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-kubelet\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227324    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-device-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227329    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227415    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/508a812b-d86e-4f50-a437-b605c2b433ee-serviceca\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227669    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227679    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-cni-binary-copy\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227710    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/508a812b-d86e-4f50-a437-b605c2b433ee-host\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227735    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-socket-dir-parent\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227761    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9tc\" (UniqueName: \"kubernetes.io/projected/b55cd361-1a12-4c28-bc06-1cfac48cce3f-kube-api-access-lj9tc\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227784    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fefbcfff-9796-44fe-a176-0e9d272bb56c-agent-certs\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227809    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227835    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gr4x\" (UniqueName: \"kubernetes.io/projected/508a812b-d86e-4f50-a437-b605c2b433ee-kube-api-access-6gr4x\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227845    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227859    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-registration-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227897    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227927    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-socket-dir-parent\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227926    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-lib-modules\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.228555 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227969    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-hosts-file\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.227985    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228013    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-system-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228028    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-lib-modules\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228034    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-sys-fs\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228050    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-netns\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228079    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-log-socket\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228081    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-registration-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-log-socket\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228111    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-env-overrides\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228165    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-hosts-file\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228231    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-sys-fs\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228251    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-run-netns\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228271    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228331    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-ovnkube-config\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228398    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228506    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-system-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.229316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228571    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228612    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/508a812b-d86e-4f50-a437-b605c2b433ee-host\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228166    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-sys\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228700    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-sys\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228710    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228746    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-etc-selinux\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228679    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c22e122d-74a1-4803-8529-6655e2a6abd2-env-overrides\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228757    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-var-lib-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228799    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-var-lib-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228832    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-etc-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228873    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-modprobe-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228913    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-etc-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228930    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-conf\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228957    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-tmp-dir\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-modprobe-d\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.228981    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-system-cni-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229002    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-netns\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229021    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-bin\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230125 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229043    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-kubernetes\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229060    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-sysctl-conf\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229064    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-bin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229099    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-bin\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229109    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-daemon-config\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-bin\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229142    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9386f7d-5f0f-48ab-8378-e577c0d87974-system-cni-dir\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229170    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-multus-certs\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229177    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-netns\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229139    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-multus-certs\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229230    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-kubernetes\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229238    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdpk\" (UniqueName: \"kubernetes.io/projected/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-kube-api-access-cwdpk\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229265    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-socket-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229272    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-tmp-dir\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229309    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-var-lib-kubelet\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229349    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-tuned\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229354    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-var-lib-kubelet\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229379    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-hostroot\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.230891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229403    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-etc-kubernetes\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229429    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229460    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-socket-dir\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229504    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-hostroot\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229609    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-daemon-config\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229619    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-k8s-cni-cncf-io\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229672    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-etc-kubernetes\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229680    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-run-k8s-cni-cncf-io\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229723    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9dj\" (UniqueName: \"kubernetes.io/projected/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kube-api-access-tv9dj\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229752    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229779    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-kubelet\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229783    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-run-openvswitch\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229816    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-systemd-units\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229841    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-multus\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229865    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-kubelet\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229866    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6kn4\" (UniqueName: \"kubernetes.io/projected/0b7ea8cb-95b7-4640-b843-efe09587073c-kube-api-access-r6kn4\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.229881    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.229909    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-netd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.231675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.230591    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-cni-netd\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.232430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.230754    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-systemd-units\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.232430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.230823    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-host-var-lib-cni-multus\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.232430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.231241    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-tmp\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.232430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.231477    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fefbcfff-9796-44fe-a176-0e9d272bb56c-agent-certs\") pod \"konnectivity-agent-nkfll\" (UID: \"fefbcfff-9796-44fe-a176-0e9d272bb56c\") " pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.233013 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.232819    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:43.233013 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.232843    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:43.233013 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.232857    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:43.233013 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.232957    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:43.732910777 +0000 UTC m=+3.084930515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233266    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfb98503-7922-4aa6-b38a-d3df7e87b193-etc-tuned\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.233365    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:43.733343158 +0000 UTC m=+3.085362886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233429    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-run\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233466    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233499    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b55cd361-1a12-4c28-bc06-1cfac48cce3f-iptables-alerter-script\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233529    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233554    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-slash\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.233713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.233585    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22e122d-74a1-4803-8529-6655e2a6abd2-ovn-node-metrics-cert\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.234439 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.234417    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfb98503-7922-4aa6-b38a-d3df7e87b193-run\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.234928 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.234900    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9386f7d-5f0f-48ab-8378-e577c0d87974-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.235514 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.235485    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b55cd361-1a12-4c28-bc06-1cfac48cce3f-iptables-alerter-script\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.235514 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.235505    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c22e122d-74a1-4803-8529-6655e2a6abd2-host-slash\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.235657 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.235554    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-multus-cni-dir\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.237344 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.237315    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dth2m\" (UniqueName: \"kubernetes.io/projected/cfb98503-7922-4aa6-b38a-d3df7e87b193-kube-api-access-dth2m\") pod \"tuned-5gqzz\" (UID: \"cfb98503-7922-4aa6-b38a-d3df7e87b193\") " pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.238157 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.238136    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22e122d-74a1-4803-8529-6655e2a6abd2-ovn-node-metrics-cert\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.238345 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.238322    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-862ww\" (UniqueName: \"kubernetes.io/projected/e9386f7d-5f0f-48ab-8378-e577c0d87974-kube-api-access-862ww\") pod \"multus-additional-cni-plugins-6z464\" (UID: \"e9386f7d-5f0f-48ab-8378-e577c0d87974\") " pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.238429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.238361    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdcmx\" (UniqueName: \"kubernetes.io/projected/0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84-kube-api-access-tdcmx\") pod \"node-resolver-lhz4g\" (UID: \"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84\") " pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.238986 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.238518    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gr4x\" (UniqueName: \"kubernetes.io/projected/508a812b-d86e-4f50-a437-b605c2b433ee-kube-api-access-6gr4x\") pod \"node-ca-5lzzb\" (UID: \"508a812b-d86e-4f50-a437-b605c2b433ee\") " pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.239065 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.239035    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j97f\" (UniqueName: \"kubernetes.io/projected/c22e122d-74a1-4803-8529-6655e2a6abd2-kube-api-access-9j97f\") pod \"ovnkube-node-qzsbw\" (UID: \"c22e122d-74a1-4803-8529-6655e2a6abd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.239727 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.239693    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9tc\" (UniqueName: \"kubernetes.io/projected/b55cd361-1a12-4c28-bc06-1cfac48cce3f-kube-api-access-lj9tc\") pod \"iptables-alerter-bvxmc\" (UID: \"b55cd361-1a12-4c28-bc06-1cfac48cce3f\") " pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.240489 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.240435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6kn4\" (UniqueName: \"kubernetes.io/projected/0b7ea8cb-95b7-4640-b843-efe09587073c-kube-api-access-r6kn4\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.240591 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.240500    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdpk\" (UniqueName: \"kubernetes.io/projected/5e2dd75b-7fb6-4651-89b5-5d875bd66a64-kube-api-access-cwdpk\") pod \"multus-mhw7h\" (UID: \"5e2dd75b-7fb6-4651-89b5-5d875bd66a64\") " pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.247433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.247415    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9dj\" (UniqueName: \"kubernetes.io/projected/98f6ace0-3da2-40cd-92f1-bdfdb7284b01-kube-api-access-tv9dj\") pod \"aws-ebs-csi-driver-node-gxsww\" (UID: \"98f6ace0-3da2-40cd-92f1-bdfdb7284b01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.411557 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.411521    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww"
Jun 02 01:50:43.423461 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.423430    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:50:43.432072 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.432053    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6z464"
Jun 02 01:50:43.436689 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.436666    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5lzzb"
Jun 02 01:50:43.444208 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.444191    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gqzz"
Jun 02 01:50:43.450725 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.450708    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lhz4g"
Jun 02 01:50:43.456264 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.456246    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhw7h"
Jun 02 01:50:43.462772 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.462757    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bvxmc"
Jun 02 01:50:43.466297 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.466277    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:50:43.667135 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.667112    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefbcfff_9796_44fe_a176_0e9d272bb56c.slice/crio-6042acd61b71981bc410ba410ad6635f8d3fe299f7ff29f0c8bb31147650f3fe WatchSource:0}: Error finding container 6042acd61b71981bc410ba410ad6635f8d3fe299f7ff29f0c8bb31147650f3fe: Status 404 returned error can't find the container with id 6042acd61b71981bc410ba410ad6635f8d3fe299f7ff29f0c8bb31147650f3fe
Jun 02 01:50:43.668452 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.668319    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb98503_7922_4aa6_b38a_d3df7e87b193.slice/crio-03da49561ae59badab6bd8e3cb351a3815fc3a6d1a82e52b1eac34251fbc4f71 WatchSource:0}: Error finding container 03da49561ae59badab6bd8e3cb351a3815fc3a6d1a82e52b1eac34251fbc4f71: Status 404 returned error can't find the container with id 03da49561ae59badab6bd8e3cb351a3815fc3a6d1a82e52b1eac34251fbc4f71
Jun 02 01:50:43.669179 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.669157    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22e122d_74a1_4803_8529_6655e2a6abd2.slice/crio-35db0a181e4e147eab5f432f638d31330ed0022addf2cd86afee1483c5cb645c WatchSource:0}: Error finding container 35db0a181e4e147eab5f432f638d31330ed0022addf2cd86afee1483c5cb645c: Status 404 returned error can't find the container with id 35db0a181e4e147eab5f432f638d31330ed0022addf2cd86afee1483c5cb645c
Jun 02 01:50:43.670542 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.670513    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55cd361_1a12_4c28_bc06_1cfac48cce3f.slice/crio-5a7e3a6b27f2e676b466f326f1f6bbdec4fdd903e553c34bbf2d547f31f55037 WatchSource:0}: Error finding container 5a7e3a6b27f2e676b466f326f1f6bbdec4fdd903e553c34bbf2d547f31f55037: Status 404 returned error can't find the container with id 5a7e3a6b27f2e676b466f326f1f6bbdec4fdd903e553c34bbf2d547f31f55037
Jun 02 01:50:43.672617 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.672596    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9386f7d_5f0f_48ab_8378_e577c0d87974.slice/crio-cd6d2202db798770fd79bbf139b08b1242386651b5c876c560ed40cd4ee7e3ef WatchSource:0}: Error finding container cd6d2202db798770fd79bbf139b08b1242386651b5c876c560ed40cd4ee7e3ef: Status 404 returned error can't find the container with id cd6d2202db798770fd79bbf139b08b1242386651b5c876c560ed40cd4ee7e3ef
Jun 02 01:50:43.674662 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.674485    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c14d0ec_f8ba_4ebb_baac_f3c28b25ae84.slice/crio-6fb391131cd63ea709b07e1994ce5ebf298c5be1698f7894d0196bbff7e70b5b WatchSource:0}: Error finding container 6fb391131cd63ea709b07e1994ce5ebf298c5be1698f7894d0196bbff7e70b5b: Status 404 returned error can't find the container with id 6fb391131cd63ea709b07e1994ce5ebf298c5be1698f7894d0196bbff7e70b5b
Jun 02 01:50:43.675610 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.675491    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2dd75b_7fb6_4651_89b5_5d875bd66a64.slice/crio-713476e6385a48b6492f65a7fdbbb8c32ec328b0064bd5ca46ebd1192ec1711f WatchSource:0}: Error finding container 713476e6385a48b6492f65a7fdbbb8c32ec328b0064bd5ca46ebd1192ec1711f: Status 404 returned error can't find the container with id 713476e6385a48b6492f65a7fdbbb8c32ec328b0064bd5ca46ebd1192ec1711f
Jun 02 01:50:43.677069 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.676986    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508a812b_d86e_4f50_a437_b605c2b433ee.slice/crio-7a9508f03c89a9578b148f263848f419f2fb63f3c733c8fcd7889ac27e925e4d WatchSource:0}: Error finding container 7a9508f03c89a9578b148f263848f419f2fb63f3c733c8fcd7889ac27e925e4d: Status 404 returned error can't find the container with id 7a9508f03c89a9578b148f263848f419f2fb63f3c733c8fcd7889ac27e925e4d
Jun 02 01:50:43.677457 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:50:43.677345    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f6ace0_3da2_40cd_92f1_bdfdb7284b01.slice/crio-264947c0f0e4eca37cb6e36362fc6d4faae4a0235c1a34ff36fde67f5dd41297 WatchSource:0}: Error finding container 264947c0f0e4eca37cb6e36362fc6d4faae4a0235c1a34ff36fde67f5dd41297: Status 404 returned error can't find the container with id 264947c0f0e4eca37cb6e36362fc6d4faae4a0235c1a34ff36fde67f5dd41297
Jun 02 01:50:43.736595 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.736557    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:43.736712 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:43.736616    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:43.736775 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736735    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:43.736775 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736747    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:43.736775 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736759    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:43.736775 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736772    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:43.736922 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736797    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:44.736784049 +0000 UTC m=+4.088803782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:43.736922 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:43.736827    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:44.736801994 +0000 UTC m=+4.088821725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:44.168469 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.168384    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:42 +0000 UTC" deadline="2028-02-29 09:10:12.198402876 +0000 UTC"
Jun 02 01:50:44.168469 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.168424    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15295h19m28.029982674s"
Jun 02 01:50:44.207885 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.207856    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:44.208046 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.207991    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:44.219275 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.219210    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gqzz" event={"ID":"cfb98503-7922-4aa6-b38a-d3df7e87b193","Type":"ContainerStarted","Data":"03da49561ae59badab6bd8e3cb351a3815fc3a6d1a82e52b1eac34251fbc4f71"}
Jun 02 01:50:44.228561 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.228512    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkfll" event={"ID":"fefbcfff-9796-44fe-a176-0e9d272bb56c","Type":"ContainerStarted","Data":"6042acd61b71981bc410ba410ad6635f8d3fe299f7ff29f0c8bb31147650f3fe"}
Jun 02 01:50:44.256421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.256390    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"33a4f9a04dffa76a96184c86815a9643","Type":"ContainerStarted","Data":"650acc87d6069dee9c7c6f14a918fa4ed702120d949d4103a8f1889749693b2a"}
Jun 02 01:50:44.269528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.269495    2567 generic.go:358] "Generic (PLEG): container finished" podID="291ac5e5e857590426ca5c17a1f85812" containerID="64f0c683b1c8234cc617df1f06753421512da6dbd71f32a971b1db87542c6bac" exitCode=0
Jun 02 01:50:44.269677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.269570    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"291ac5e5e857590426ca5c17a1f85812","Type":"ContainerDied","Data":"64f0c683b1c8234cc617df1f06753421512da6dbd71f32a971b1db87542c6bac"}
Jun 02 01:50:44.278957 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.278930    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5lzzb" event={"ID":"508a812b-d86e-4f50-a437-b605c2b433ee","Type":"ContainerStarted","Data":"7a9508f03c89a9578b148f263848f419f2fb63f3c733c8fcd7889ac27e925e4d"}
Jun 02 01:50:44.288029 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.287501    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" podStartSLOduration=2.287484822 podStartE2EDuration="2.287484822s" podCreationTimestamp="2026-06-02 01:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:44.272184618 +0000 UTC m=+3.624204384" watchObservedRunningTime="2026-06-02 01:50:44.287484822 +0000 UTC m=+3.639504574"
Jun 02 01:50:44.296744 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.296644    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerStarted","Data":"cd6d2202db798770fd79bbf139b08b1242386651b5c876c560ed40cd4ee7e3ef"}
Jun 02 01:50:44.307752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.307704    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bvxmc" event={"ID":"b55cd361-1a12-4c28-bc06-1cfac48cce3f","Type":"ContainerStarted","Data":"5a7e3a6b27f2e676b466f326f1f6bbdec4fdd903e553c34bbf2d547f31f55037"}
Jun 02 01:50:44.325183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.325149    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww" event={"ID":"98f6ace0-3da2-40cd-92f1-bdfdb7284b01","Type":"ContainerStarted","Data":"264947c0f0e4eca37cb6e36362fc6d4faae4a0235c1a34ff36fde67f5dd41297"}
Jun 02 01:50:44.330084 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.330053    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhw7h" event={"ID":"5e2dd75b-7fb6-4651-89b5-5d875bd66a64","Type":"ContainerStarted","Data":"713476e6385a48b6492f65a7fdbbb8c32ec328b0064bd5ca46ebd1192ec1711f"}
Jun 02 01:50:44.341312 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.341260    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lhz4g" event={"ID":"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84","Type":"ContainerStarted","Data":"6fb391131cd63ea709b07e1994ce5ebf298c5be1698f7894d0196bbff7e70b5b"}
Jun 02 01:50:44.349343 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.349114    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"35db0a181e4e147eab5f432f638d31330ed0022addf2cd86afee1483c5cb645c"}
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.744628    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:44.744703    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744790    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744816    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744832    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744846    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744867    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:46.7448448 +0000 UTC m=+6.096864539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:44.744977 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:44.744895    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:46.744879044 +0000 UTC m=+6.096898785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:45.210556 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:45.210526    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:45.211003 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:45.210657    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:45.386848 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:45.386788    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"291ac5e5e857590426ca5c17a1f85812","Type":"ContainerStarted","Data":"3b6894efddd20e1a1f3a3171ecd2b55bf07184481ce519f4ebab0367d1eee9c1"}
Jun 02 01:50:46.208924 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:46.208398    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:46.208924 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.208523    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:46.764115    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:46.764185    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764326    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764390    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:50.764370765 +0000 UTC m=+10.116390507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764823    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764859    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:46.764876 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764877    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:46.765594 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:46.764941    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:50.764919212 +0000 UTC m=+10.116939040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:47.208450 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:47.207922    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:47.208450 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:47.208069    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:48.208454 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:48.208418    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:48.208898 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:48.208547    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:49.209638 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:49.209310    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:49.209638 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:49.209456    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:50.208592 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:50.208555    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:50.208754 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.208703    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:50.794593    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:50.794664    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.794816    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.794836    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.794849    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.794908    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:58.794890022 +0000 UTC m=+18.146909765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.795318    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:50.795406 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:50.795374    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:58.795358045 +0000 UTC m=+18.147377777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:51.209077 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:51.209049    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:51.209430 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:51.209395    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:52.207729 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:52.207700    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:52.208182 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:52.207815    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:53.208093 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:53.208001    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:53.208540 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:53.208150    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:54.208457 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:54.208426    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:54.208858 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:54.208555    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:55.208088 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:55.208055    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:55.208290 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:55.208192    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:56.207809 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:56.207779    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:56.208189 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:56.207889    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:57.208142 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:57.208111    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:57.208606 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:57.208260    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:50:58.208349 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:58.208319    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:58.208841 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.208413    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:50:58.850818 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:58.850782    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:50:58.851006 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:58.850852    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:58.851006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.850965    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:58.851006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.850968    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:50:58.851006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.850993    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:50:58.851006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.851007    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:58.851233 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.851024    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:51:14.851004536 +0000 UTC m=+34.203024262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:50:58.851233 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:58.851052    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:14.851036993 +0000 UTC m=+34.203056726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:50:59.208536 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:50:59.208504    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:50:59.208997 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:50:59.208647    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:00.208016 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:00.207988    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:00.208170 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:00.208100    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:01.208902 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:01.208868    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:01.209428 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:01.208982    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:02.208036 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.207883    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:02.208187 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:02.208162    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:02.414935 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.414894    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gqzz" event={"ID":"cfb98503-7922-4aa6-b38a-d3df7e87b193","Type":"ContainerStarted","Data":"2f66e99090e6ffbd9a9792d83bbd6a328764a40dbcb56a8a09ce499fd0810f96"}
Jun 02 01:51:02.416071 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.416044    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkfll" event={"ID":"fefbcfff-9796-44fe-a176-0e9d272bb56c","Type":"ContainerStarted","Data":"5d66061064d3a1ccba624f1e0ea2d41b967e760f25b9a0099f8692fc97f98b9c"}
Jun 02 01:51:02.418293 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.418270    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerStarted","Data":"0619a4d238a50609d5e605cd26db2b04c5de19730c710ed75638e25f878af89c"}
Jun 02 01:51:02.419331 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.419308    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww" event={"ID":"98f6ace0-3da2-40cd-92f1-bdfdb7284b01","Type":"ContainerStarted","Data":"b4ad04b4a22947b2116afb2790881e1e5b9a3485075c23119339c14f90395d27"}
Jun 02 01:51:02.420332 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.420311    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhw7h" event={"ID":"5e2dd75b-7fb6-4651-89b5-5d875bd66a64","Type":"ContainerStarted","Data":"63f0f5d20e7e5f5c71238642618367813462bc00b91695009698acbc50f6140e"}
Jun 02 01:51:02.421575 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.421554    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lhz4g" event={"ID":"0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84","Type":"ContainerStarted","Data":"2555501341ec4041c100bcf3cc2da6bd0586ba18acaed75299aa12f912cd328b"}
Jun 02 01:51:02.429546 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.429462    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" podStartSLOduration=20.429453349 podStartE2EDuration="20.429453349s" podCreationTimestamp="2026-06-02 01:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:45.401857511 +0000 UTC m=+4.753877260" watchObservedRunningTime="2026-06-02 01:51:02.429453349 +0000 UTC m=+21.781473111"
Jun 02 01:51:02.429843 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.429819    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5gqzz" podStartSLOduration=3.025037987 podStartE2EDuration="21.429813439s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.670368716 +0000 UTC m=+3.022388445" lastFinishedPulling="2026-06-02 01:51:02.075144156 +0000 UTC m=+21.427163897" observedRunningTime="2026-06-02 01:51:02.429393442 +0000 UTC m=+21.781413190" watchObservedRunningTime="2026-06-02 01:51:02.429813439 +0000 UTC m=+21.781833188"
Jun 02 01:51:02.443310 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.443279    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lhz4g" podStartSLOduration=2.987455793 podStartE2EDuration="21.443270597s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.676166891 +0000 UTC m=+3.028186617" lastFinishedPulling="2026-06-02 01:51:02.131981695 +0000 UTC m=+21.484001421" observedRunningTime="2026-06-02 01:51:02.442786952 +0000 UTC m=+21.794806702" watchObservedRunningTime="2026-06-02 01:51:02.443270597 +0000 UTC m=+21.795290346"
Jun 02 01:51:02.460893 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.460855    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mhw7h" podStartSLOduration=3.007500766 podStartE2EDuration="21.460844618s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.67814764 +0000 UTC m=+3.030167373" lastFinishedPulling="2026-06-02 01:51:02.131491483 +0000 UTC m=+21.483511225" observedRunningTime="2026-06-02 01:51:02.460506955 +0000 UTC m=+21.812526724" watchObservedRunningTime="2026-06-02 01:51:02.460844618 +0000 UTC m=+21.812864367"
Jun 02 01:51:02.473961 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:02.473929    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nkfll" podStartSLOduration=3.130096731 podStartE2EDuration="21.473918385s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.668657314 +0000 UTC m=+3.020677054" lastFinishedPulling="2026-06-02 01:51:02.012478966 +0000 UTC m=+21.364498708" observedRunningTime="2026-06-02 01:51:02.473567767 +0000 UTC m=+21.825587526" watchObservedRunningTime="2026-06-02 01:51:02.473918385 +0000 UTC m=+21.825938151"
Jun 02 01:51:03.208563 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.208349    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:03.208709 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:03.208686    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:03.234023 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.233999    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 02 01:51:03.424348 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.424120    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5lzzb" event={"ID":"508a812b-d86e-4f50-a437-b605c2b433ee","Type":"ContainerStarted","Data":"63f675c0b7da7d4e1f11279092af5850da8a57614c477293db64c245d304f108"}
Jun 02 01:51:03.425552 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.425527    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="0619a4d238a50609d5e605cd26db2b04c5de19730c710ed75638e25f878af89c" exitCode=0
Jun 02 01:51:03.425652 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.425605    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"0619a4d238a50609d5e605cd26db2b04c5de19730c710ed75638e25f878af89c"}
Jun 02 01:51:03.427134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.427115    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww" event={"ID":"98f6ace0-3da2-40cd-92f1-bdfdb7284b01","Type":"ContainerStarted","Data":"7e2a63194e00b6efbf0afa98ccb40d80b314f75037f353b0dd732442f17a3bd5"}
Jun 02 01:51:03.429251 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429173    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:51:03.429504 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429485    2567 generic.go:358] "Generic (PLEG): container finished" podID="c22e122d-74a1-4803-8529-6655e2a6abd2" containerID="83fe3b33fa49a02e3968bc0fedbd668af44e5fe0ede388ece9a73a2229b5f2c9" exitCode=1
Jun 02 01:51:03.429621 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429597    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"9607b88aa8d2b926c00439a56d834d219d6c169ceab5bdfeda296032070bd4ae"}
Jun 02 01:51:03.429668 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429633    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"8ce9cce02c32d5dad51d5457f296914b9b80f5cd4e92a8c54c0ba713c77a0edc"}
Jun 02 01:51:03.429668 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429648    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"4887d7cd8a5e8c4c68228f7d57d23772a8367664d019b876bea1d728c8f54287"}
Jun 02 01:51:03.429668 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429663    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerDied","Data":"83fe3b33fa49a02e3968bc0fedbd668af44e5fe0ede388ece9a73a2229b5f2c9"}
Jun 02 01:51:03.429763 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.429678    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"5d88e0c579bd9c6712e94d72ddabd334f59ee1e7e0dd543e223223f9af95472c"}
Jun 02 01:51:03.437254 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:03.437199    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5lzzb" podStartSLOduration=3.984048413 podStartE2EDuration="22.437178107s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.678614985 +0000 UTC m=+3.030634712" lastFinishedPulling="2026-06-02 01:51:02.131744664 +0000 UTC m=+21.483764406" observedRunningTime="2026-06-02 01:51:03.436782212 +0000 UTC m=+22.788801961" watchObservedRunningTime="2026-06-02 01:51:03.437178107 +0000 UTC m=+22.789197856"
Jun 02 01:51:04.186283 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.186175    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:51:03.234015794Z","UUID":"5a103c61-99ca-4e04-843e-7f7daa6ca9ee","Handler":null,"Name":"","Endpoint":""}
Jun 02 01:51:04.189755 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.189719    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 02 01:51:04.189755 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.189751    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 02 01:51:04.207560 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.207535    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:04.207690 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:04.207647    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:04.433510 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.433445    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww" event={"ID":"98f6ace0-3da2-40cd-92f1-bdfdb7284b01","Type":"ContainerStarted","Data":"d070a2e1d7321b265c8aa31a78a0078e42185ab5ce685fb5b9ac89afafa8bc40"}
Jun 02 01:51:04.436060 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.436040    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:51:04.436483 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.436421    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"3c4ec03c4202b453e9c3f0bc7eb5a31829e62fa4e33b275f17c7333c6687e0ae"}
Jun 02 01:51:04.438009 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.437986    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bvxmc" event={"ID":"b55cd361-1a12-4c28-bc06-1cfac48cce3f","Type":"ContainerStarted","Data":"ff01c364a2b8fde46a7f873ee8417ed3e0b0bf37bc0fd49fc34f453fc08822ba"}
Jun 02 01:51:04.450375 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.450335    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gxsww" podStartSLOduration=2.876467493 podStartE2EDuration="23.450320968s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.679528995 +0000 UTC m=+3.031548739" lastFinishedPulling="2026-06-02 01:51:04.25338248 +0000 UTC m=+23.605402214" observedRunningTime="2026-06-02 01:51:04.449837809 +0000 UTC m=+23.801857560" watchObservedRunningTime="2026-06-02 01:51:04.450320968 +0000 UTC m=+23.802340717"
Jun 02 01:51:04.462628 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.462580    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bvxmc" podStartSLOduration=5.05976431 podStartE2EDuration="23.462563772s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.672369867 +0000 UTC m=+3.024389607" lastFinishedPulling="2026-06-02 01:51:02.075169332 +0000 UTC m=+21.427189069" observedRunningTime="2026-06-02 01:51:04.461985187 +0000 UTC m=+23.814004940" watchObservedRunningTime="2026-06-02 01:51:04.462563772 +0000 UTC m=+23.814583522"
Jun 02 01:51:04.803363 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.803284    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:51:04.803910 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:04.803889    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:51:05.208344 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:05.208314    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:05.208522 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:05.208439    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:06.207750 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:06.207679    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:06.208362 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:06.207786    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:06.445120 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:06.445093    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:51:06.445454 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:06.445427    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"d388d8c137824ea1e3d9383238db760e9242ee8a701c88a1649e68de46daa5b7"}
Jun 02 01:51:07.208132 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:07.208099    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:07.208602 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:07.208238    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:08.207965 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.207784    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:08.208137 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:08.208032    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:08.449943 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.449904    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="da216bd611f86a16a22fb1aad15d1e5a8f9f1d723c6c09398e64e4423f0891c9" exitCode=0
Jun 02 01:51:08.450435 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.449995    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"da216bd611f86a16a22fb1aad15d1e5a8f9f1d723c6c09398e64e4423f0891c9"}
Jun 02 01:51:08.453017 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.453001    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:51:08.453344 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.453324    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"5a5c8c9ae9db86cc63c0499fdd20a3bdae9ab31560d73b6a509015e14cc7a58f"}
Jun 02 01:51:08.453670 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.453648    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:08.453880 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.453865    2567 scope.go:117] "RemoveContainer" containerID="83fe3b33fa49a02e3968bc0fedbd668af44e5fe0ede388ece9a73a2229b5f2c9"
Jun 02 01:51:08.469979 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.469959    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:08.599421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.599386    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:51:08.599557 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.599530    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 02 01:51:08.600075 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:08.600053    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nkfll"
Jun 02 01:51:09.208678 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.208652    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:09.208821 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:09.208788    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:09.460313 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.458909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:51:09.462494 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.462462    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" event={"ID":"c22e122d-74a1-4803-8529-6655e2a6abd2","Type":"ContainerStarted","Data":"04d1a26b16bbf5c07bc4005a2e13c70514e3a51ec2a633bb9ba6b9304b6dda55"}
Jun 02 01:51:09.462977 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.462951    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:09.463076 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.463028    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:09.464762 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.464737    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="ecf4f30668861ea3d69cf0e5cf7f04ba37ea6180ef559bbd91af7e3e5c2332a5" exitCode=0
Jun 02 01:51:09.464860 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.464806    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"ecf4f30668861ea3d69cf0e5cf7f04ba37ea6180ef559bbd91af7e3e5c2332a5"}
Jun 02 01:51:09.478384 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.478366    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:09.487060 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.487021    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw" podStartSLOduration=9.568082833 podStartE2EDuration="28.487009362s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.67156665 +0000 UTC m=+3.023586377" lastFinishedPulling="2026-06-02 01:51:02.590493179 +0000 UTC m=+21.942512906" observedRunningTime="2026-06-02 01:51:09.485923281 +0000 UTC m=+28.837943030" watchObservedRunningTime="2026-06-02 01:51:09.487009362 +0000 UTC m=+28.839029111"
Jun 02 01:51:09.651379 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.651348    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-495wn"]
Jun 02 01:51:09.651553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.651475    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:09.651613 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:09.651596    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:09.653755 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.653727    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qsfsw"]
Jun 02 01:51:09.653939 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:09.653831    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:09.653939 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:09.653898    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:10.469189 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:10.469151    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="0587d25dac59aabf9ada1c02cde8fc203afe70abadba9f87255d2f4fbd2411dd" exitCode=0
Jun 02 01:51:10.469834 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:10.469228    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"0587d25dac59aabf9ada1c02cde8fc203afe70abadba9f87255d2f4fbd2411dd"}
Jun 02 01:51:11.208909 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:11.208865    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:11.209084 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:11.209039    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:11.209084 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:11.209039    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:11.209299 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:11.209147    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:13.207825 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:13.207788    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:13.208445 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:13.207806    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:13.208445 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:13.207923    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:13.208445 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:13.208018    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:14.870152 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:14.869970    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:14.870152 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870136    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 02 01:51:14.870152 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870158    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 02 01:51:14.870828 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870169    2567 projected.go:194] Error preparing data for projected volume kube-api-access-67glk for pod openshift-network-diagnostics/network-check-target-qsfsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:51:14.870828 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:14.870175    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:14.870828 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870239    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk podName:7a985774-ce7a-4186-a634-4029e3b4df87 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:46.870202604 +0000 UTC m=+66.222222349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-67glk" (UniqueName: "kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk") pod "network-check-target-qsfsw" (UID: "7a985774-ce7a-4186-a634-4029e3b4df87") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 02 01:51:14.870828 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870269    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:51:14.870828 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:14.870319    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:51:46.870306652 +0000 UTC m=+66.222326383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 02 01:51:15.208159 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:15.208128    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:15.208345 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:15.208286    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsfsw" podUID="7a985774-ce7a-4186-a634-4029e3b4df87"
Jun 02 01:51:15.208418 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:15.208342    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:15.208474 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:15.208459    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:51:15.971659 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:15.971624    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeReady"
Jun 02 01:51:15.972104 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:15.971755    2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 02 01:51:16.011810 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.011779    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfxxl"]
Jun 02 01:51:16.039203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.039076    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hcmq7"]
Jun 02 01:51:16.039203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.039176    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.041475 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.041449    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 02 01:51:16.041606 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.041527    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\""
Jun 02 01:51:16.041606 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.041450    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 02 01:51:16.061066 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.061038    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfxxl"]
Jun 02 01:51:16.061201 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.061083    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.061321 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.061083    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hcmq7"]
Jun 02 01:51:16.063109 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.063088    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 02 01:51:16.063258 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.063235    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\""
Jun 02 01:51:16.063349 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.063336    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 02 01:51:16.063456 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.063439    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 02 01:51:16.178558 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eadbf4e3-85da-4def-ad0a-10806f3a7620-config-volume\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.178733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.178733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eadbf4e3-85da-4def-ad0a-10806f3a7620-tmp-dir\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.178733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5mc\" (UniqueName: \"kubernetes.io/projected/eadbf4e3-85da-4def-ad0a-10806f3a7620-kube-api-access-dt5mc\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.178884 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.178884 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.178759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dttzw\" (UniqueName: \"kubernetes.io/projected/ac3dccf4-a0bf-4842-a256-886a277947bb-kube-api-access-dttzw\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.279523 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279485    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eadbf4e3-85da-4def-ad0a-10806f3a7620-config-volume\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279529    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279560    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eadbf4e3-85da-4def-ad0a-10806f3a7620-tmp-dir\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279632    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5mc\" (UniqueName: \"kubernetes.io/projected/eadbf4e3-85da-4def-ad0a-10806f3a7620-kube-api-access-dt5mc\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.279649    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279663    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279687    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dttzw\" (UniqueName: \"kubernetes.io/projected/ac3dccf4-a0bf-4842-a256-886a277947bb-kube-api-access-dttzw\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.279716 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.279719    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:16.779698883 +0000 UTC m=+36.131718613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:16.280073 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.279801    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:16.280073 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.279852    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:16.779836731 +0000 UTC m=+36.131856476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:16.280073 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.279876    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eadbf4e3-85da-4def-ad0a-10806f3a7620-tmp-dir\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.280169 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.280084    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eadbf4e3-85da-4def-ad0a-10806f3a7620-config-volume\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.294443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.294390    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5mc\" (UniqueName: \"kubernetes.io/projected/eadbf4e3-85da-4def-ad0a-10806f3a7620-kube-api-access-dt5mc\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.294549 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.294470    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dttzw\" (UniqueName: \"kubernetes.io/projected/ac3dccf4-a0bf-4842-a256-886a277947bb-kube-api-access-dttzw\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.781879 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.781843    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:16.782068 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:16.781922    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:16.782068 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.781995    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:16.782068 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.782017    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:16.782210 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.782081    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:17.782058738 +0000 UTC m=+37.134078483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:16.782210 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:16.782102    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:17.782093156 +0000 UTC m=+37.134112887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:17.207961 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.207924    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:17.208381 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.207925    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:17.213002 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.212974    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 01:51:17.213127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.213074    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 02 01:51:17.213127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.213104    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 02 01:51:17.213268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.213248    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\""
Jun 02 01:51:17.213437 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.213412    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\""
Jun 02 01:51:17.790433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.790341    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:17.790433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:17.790402    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:17.790631 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:17.790494    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:17.790631 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:17.790504    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:17.790631 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:17.790565    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:19.790545603 +0000 UTC m=+39.142565342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:17.790631 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:17.790582    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:19.790574591 +0000 UTC m=+39.142594319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:18.486917 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:18.486884    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="334df31d98455d0b8697fe9904ddbc8491a82e0b5e0552d3e8df8a95de210747" exitCode=0
Jun 02 01:51:18.487429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:18.486925    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"334df31d98455d0b8697fe9904ddbc8491a82e0b5e0552d3e8df8a95de210747"}
Jun 02 01:51:19.491496 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:19.491410    2567 generic.go:358] "Generic (PLEG): container finished" podID="e9386f7d-5f0f-48ab-8378-e577c0d87974" containerID="fa735c5d4fbf4c6a75e2894d266698493ba1fd3fbeb5f5bf7d8f6c9d16b5cc2f" exitCode=0
Jun 02 01:51:19.491496 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:19.491485    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerDied","Data":"fa735c5d4fbf4c6a75e2894d266698493ba1fd3fbeb5f5bf7d8f6c9d16b5cc2f"}
Jun 02 01:51:19.804262 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:19.804022    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:19.804262 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:19.804257    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:19.804484 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:19.804157    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:19.804484 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:19.804340    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:19.804484 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:19.804343    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:23.804321039 +0000 UTC m=+43.156340773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:19.804484 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:19.804376    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:23.804364859 +0000 UTC m=+43.156384586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:20.496007 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:20.495969    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z464" event={"ID":"e9386f7d-5f0f-48ab-8378-e577c0d87974","Type":"ContainerStarted","Data":"51aa0581e42ad87de1540be02b698b54ae0806a923978b12df442afb4f55f702"}
Jun 02 01:51:20.520356 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:20.520309    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6z464" podStartSLOduration=5.771549477 podStartE2EDuration="39.52029673s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:50:43.674584369 +0000 UTC m=+3.026604110" lastFinishedPulling="2026-06-02 01:51:17.423331634 +0000 UTC m=+36.775351363" observedRunningTime="2026-06-02 01:51:20.51917744 +0000 UTC m=+39.871197203" watchObservedRunningTime="2026-06-02 01:51:20.52029673 +0000 UTC m=+39.872316479"
Jun 02 01:51:23.829527 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:23.829481    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:23.829972 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:23.829543    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:23.829972 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:23.829641    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:23.829972 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:23.829704    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:31.829688982 +0000 UTC m=+51.181708714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:23.829972 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:23.829645    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:23.829972 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:23.829767    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:31.829753212 +0000 UTC m=+51.181772956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:31.882527 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:31.882485    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:31.883052 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:31.882541    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:31.883052 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:31.882626    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:31.883052 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:31.882629    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:31.883052 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:31.882684    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:51:47.882668752 +0000 UTC m=+67.234688483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:31.883052 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:31.882698    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:47.88269264 +0000 UTC m=+67.234712372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:41.481483 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:41.481456    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qzsbw"
Jun 02 01:51:46.886232 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.886179    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:51:46.886703 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.886329    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:46.888512 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.888483    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 02 01:51:46.888639 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.888600    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 02 01:51:46.896428 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:46.896411    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 02 01:51:46.896527 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:46.896476    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:52:50.896461636 +0000 UTC m=+130.248481380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : secret "metrics-daemon-secret" not found
Jun 02 01:51:46.898244 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.898209    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 02 01:51:46.909833 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.909797    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67glk\" (UniqueName: \"kubernetes.io/projected/7a985774-ce7a-4186-a634-4029e3b4df87-kube-api-access-67glk\") pod \"network-check-target-qsfsw\" (UID: \"7a985774-ce7a-4186-a634-4029e3b4df87\") " pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:46.923770 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.923752    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\""
Jun 02 01:51:46.932299 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:46.932281    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:47.073671 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:47.073644    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qsfsw"]
Jun 02 01:51:47.076997 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:51:47.076963    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a985774_ce7a_4186_a634_4029e3b4df87.slice/crio-a3fd4f6fb5aa04d73161b3b976d2af246beabd8c02d0aa9a2677605ac0783057 WatchSource:0}: Error finding container a3fd4f6fb5aa04d73161b3b976d2af246beabd8c02d0aa9a2677605ac0783057: Status 404 returned error can't find the container with id a3fd4f6fb5aa04d73161b3b976d2af246beabd8c02d0aa9a2677605ac0783057
Jun 02 01:51:47.549710 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:47.549666    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qsfsw" event={"ID":"7a985774-ce7a-4186-a634-4029e3b4df87","Type":"ContainerStarted","Data":"a3fd4f6fb5aa04d73161b3b976d2af246beabd8c02d0aa9a2677605ac0783057"}
Jun 02 01:51:47.893114 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:47.893033    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:51:47.893114 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:47.893100    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:51:47.893648 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:47.893189    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:51:47.893648 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:47.893289    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:19.893267826 +0000 UTC m=+99.245287575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:51:47.893648 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:47.893324    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:51:47.893648 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:51:47.893409    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:52:19.89338859 +0000 UTC m=+99.245408322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:51:50.557446 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:50.557410    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qsfsw" event={"ID":"7a985774-ce7a-4186-a634-4029e3b4df87","Type":"ContainerStarted","Data":"b0af77c47d4f6a357ea9a6f53ec737707fa19b60a7cfbeb26a544f32512d1eef"}
Jun 02 01:51:50.557805 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:50.557551    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:51:50.572822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:51:50.572765    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qsfsw" podStartSLOduration=66.956247651 podStartE2EDuration="1m9.572750788s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:51:47.078799605 +0000 UTC m=+66.430819335" lastFinishedPulling="2026-06-02 01:51:49.695302742 +0000 UTC m=+69.047322472" observedRunningTime="2026-06-02 01:51:50.572429124 +0000 UTC m=+69.924448874" watchObservedRunningTime="2026-06-02 01:51:50.572750788 +0000 UTC m=+69.924770538"
Jun 02 01:52:19.904995 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:52:19.904958    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:52:19.905464 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:52:19.905015    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:52:19.905464 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:19.905093    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:52:19.905464 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:19.905094    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:52:19.905464 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:19.905156    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:53:23.905140468 +0000 UTC m=+163.257160194 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:52:19.905464 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:19.905170    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:23.90516324 +0000 UTC m=+163.257182966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:52:21.561705 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:52:21.561676    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qsfsw"
Jun 02 01:52:50.990363 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:52:50.990325    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:52:50.990819 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:50.990438    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 02 01:52:50.990819 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:52:50.990495    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs podName:0b7ea8cb-95b7-4640-b843-efe09587073c nodeName:}" failed. No retries permitted until 2026-06-02 01:54:52.990478802 +0000 UTC m=+252.342498530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs") pod "network-metrics-daemon-495wn" (UID: "0b7ea8cb-95b7-4640-b843-efe09587073c") : secret "metrics-daemon-secret" not found
Jun 02 01:53:11.381960 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.381921    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"]
Jun 02 01:53:11.384689 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.384673    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:53:11.384832 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.384815    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.386640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.386618    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 02 01:53:11.386640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.386625    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:53:11.386812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.386658    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9p867\""
Jun 02 01:53:11.386812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.386691    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 02 01:53:11.387465 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.387447    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.389105 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.389087    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 02 01:53:11.389340 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.389327    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 02 01:53:11.389863 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.389831    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 02 01:53:11.390227 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.390197    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2bbv\""
Jun 02 01:53:11.398507 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.398479    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 02 01:53:11.399129 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.399112    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"]
Jun 02 01:53:11.399852 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.399834    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:53:11.481326 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.481300    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"]
Jun 02 01:53:11.484151 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.484128    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.486686 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.486664    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:53:11.486777 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.486742    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 02 01:53:11.486777 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.486766    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 02 01:53:11.488647 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.488630    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 02 01:53:11.488749 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.488685    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t9h8w\""
Jun 02 01:53:11.502942 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.502917    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"]
Jun 02 01:53:11.528375 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528375 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjv68\" (UniqueName: \"kubernetes.io/projected/bc359b41-33eb-48a1-91d8-5dd68149659c-kube-api-access-gjv68\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.528553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528655 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhgb\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528655 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528655 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.528655 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.528655 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.528648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.574054 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.574026    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"]
Jun 02 01:53:11.576741 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.576715    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.577350 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.577327    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dwswb"]
Jun 02 01:53:11.578635 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.578617    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 02 01:53:11.578735 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.578638    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hxl6\""
Jun 02 01:53:11.578735 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.578639    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 02 01:53:11.579887 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.579872    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.581568 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.581550    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xs9zh\""
Jun 02 01:53:11.581657 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.581557    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 02 01:53:11.581657 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.581638    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 02 01:53:11.581657 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.581654    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 02 01:53:11.581775 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.581671    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 02 01:53:11.587428 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.587408    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"]
Jun 02 01:53:11.587529 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.587431    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 02 01:53:11.588233 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.588191    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dwswb"]
Jun 02 01:53:11.629611 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629580    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.629611 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j546l\" (UniqueName: \"kubernetes.io/projected/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-kube-api-access-j546l\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.629825 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629806    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhgb\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.629862 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629842    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.629915 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629860    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.629915 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629882    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.629915 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629900    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-config\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629960    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.629982    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.629999    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.630010    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjv68\" (UniqueName: \"kubernetes.io/projected/bc359b41-33eb-48a1-91d8-5dd68149659c-kube-api-access-gjv68\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.630040    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.630070 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.630064    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls podName:bc359b41-33eb-48a1-91d8-5dd68149659c nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.130041481 +0000 UTC m=+151.482061210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6r4zt" (UID: "bc359b41-33eb-48a1-91d8-5dd68149659c") : secret "samples-operator-tls" not found
Jun 02 01:53:11.630443 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.630102    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:53:11.630443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.630104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-serving-cert\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.630443 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.630117    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b5df57-qzh7p: secret "image-registry-tls" not found
Jun 02 01:53:11.630443 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.630192    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls podName:ba55241b-0cb5-41df-95f7-2f4644e48c9d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.130174036 +0000 UTC m=+151.482193771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls") pod "image-registry-7869b5df57-qzh7p" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d") : secret "image-registry-tls" not found
Jun 02 01:53:11.630443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.630439    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.630690 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.630675    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.631032 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.631012    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.632149 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.632104    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.632228 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.632203    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.650140 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.650114    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.650459 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.650440    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhgb\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:11.650933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.650911    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjv68\" (UniqueName: \"kubernetes.io/projected/bc359b41-33eb-48a1-91d8-5dd68149659c-kube-api-access-gjv68\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:11.730853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.730822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-service-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731009 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.730872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fz84\" (UniqueName: \"kubernetes.io/projected/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-kube-api-access-5fz84\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731009 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.730931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbbe9a16-49f7-4add-aa2d-0336c8019121-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.731009 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.730970    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-config\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.731009 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.730992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-snapshots\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731172 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.731172 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-tmp\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731172 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731102    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-serving-cert\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.731300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731173    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j546l\" (UniqueName: \"kubernetes.io/projected/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-kube-api-access-j546l\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.731300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-serving-cert\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.731551 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.731530    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-config\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.733162 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.733147    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-serving-cert\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.738581 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.738560    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j546l\" (UniqueName: \"kubernetes.io/projected/80ada9d5-0ec0-43f1-a401-6fb94a3a4749-kube-api-access-j546l\") pod \"service-ca-operator-69877444c-49qwn\" (UID: \"80ada9d5-0ec0-43f1-a401-6fb94a3a4749\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.792674 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.792649    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"
Jun 02 01:53:11.832059 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832021    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbbe9a16-49f7-4add-aa2d-0336c8019121-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.832224 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832082    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-snapshots\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832224 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832122    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.832307 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.832257    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:11.832307 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832274    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-tmp\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832368 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:11.832338    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.332318869 +0000 UTC m=+151.684338616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:11.832406 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832389    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832446 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832416    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-serving-cert\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832481 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832452    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-service-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832516 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832499    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fz84\" (UniqueName: \"kubernetes.io/projected/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-kube-api-access-5fz84\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832722 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832702    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-tmp\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.832773 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832750    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbbe9a16-49f7-4add-aa2d-0336c8019121-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:11.832810 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.832777    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-snapshots\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.833388 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.833364    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-service-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.833549 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.833504    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.834937 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.834918    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-serving-cert\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.843359 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.843313    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fz84\" (UniqueName: \"kubernetes.io/projected/7c7b5ebc-d3df-41a4-9428-1f44a2c22518-kube-api-access-5fz84\") pod \"insights-operator-788bf58df5-dwswb\" (UID: \"7c7b5ebc-d3df-41a4-9428-1f44a2c22518\") " pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.893808 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.893740    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dwswb"
Jun 02 01:53:11.909946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:11.909923    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-49qwn"]
Jun 02 01:53:11.913397 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:11.913368    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ada9d5_0ec0_43f1_a401_6fb94a3a4749.slice/crio-62385e0b6ec4ff81a2573ac479f0350f1fd4d559760942f984bd859532f2ef53 WatchSource:0}: Error finding container 62385e0b6ec4ff81a2573ac479f0350f1fd4d559760942f984bd859532f2ef53: Status 404 returned error can't find the container with id 62385e0b6ec4ff81a2573ac479f0350f1fd4d559760942f984bd859532f2ef53
Jun 02 01:53:12.010726 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.010690    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dwswb"]
Jun 02 01:53:12.015893 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:12.015868    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7b5ebc_d3df_41a4_9428_1f44a2c22518.slice/crio-eee4c819f1bc82fe28a217f7cb49266104267d4d82b7fb96564c6b7490222f9c WatchSource:0}: Error finding container eee4c819f1bc82fe28a217f7cb49266104267d4d82b7fb96564c6b7490222f9c: Status 404 returned error can't find the container with id eee4c819f1bc82fe28a217f7cb49266104267d4d82b7fb96564c6b7490222f9c
Jun 02 01:53:12.135773 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.135737    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:12.135928 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.135794    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:12.135928 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.135883    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 01:53:12.135928 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.135910    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:53:12.135928 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.135920    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b5df57-qzh7p: secret "image-registry-tls" not found
Jun 02 01:53:12.136060 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.135946    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls podName:bc359b41-33eb-48a1-91d8-5dd68149659c nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.135931255 +0000 UTC m=+152.487950981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6r4zt" (UID: "bc359b41-33eb-48a1-91d8-5dd68149659c") : secret "samples-operator-tls" not found
Jun 02 01:53:12.136060 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.135965    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls podName:ba55241b-0cb5-41df-95f7-2f4644e48c9d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.135953606 +0000 UTC m=+152.487973333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls") pod "image-registry-7869b5df57-qzh7p" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d") : secret "image-registry-tls" not found
Jun 02 01:53:12.337971 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.337938    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:12.338146 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.338048    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:12.338146 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:12.338098    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.33808587 +0000 UTC m=+152.690105598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:12.713817 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.713726    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dwswb" event={"ID":"7c7b5ebc-d3df-41a4-9428-1f44a2c22518","Type":"ContainerStarted","Data":"eee4c819f1bc82fe28a217f7cb49266104267d4d82b7fb96564c6b7490222f9c"}
Jun 02 01:53:12.714933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:12.714891    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn" event={"ID":"80ada9d5-0ec0-43f1-a401-6fb94a3a4749","Type":"ContainerStarted","Data":"62385e0b6ec4ff81a2573ac479f0350f1fd4d559760942f984bd859532f2ef53"}
Jun 02 01:53:13.145376 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:13.145346    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:13.145543 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:13.145439    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:13.145543 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.145505    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:53:13.145543 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.145522    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b5df57-qzh7p: secret "image-registry-tls" not found
Jun 02 01:53:13.145543 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.145528    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 01:53:13.145732 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.145585    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls podName:ba55241b-0cb5-41df-95f7-2f4644e48c9d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.145567596 +0000 UTC m=+154.497587327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls") pod "image-registry-7869b5df57-qzh7p" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d") : secret "image-registry-tls" not found
Jun 02 01:53:13.145732 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.145600    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls podName:bc359b41-33eb-48a1-91d8-5dd68149659c nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.145595047 +0000 UTC m=+154.497614773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6r4zt" (UID: "bc359b41-33eb-48a1-91d8-5dd68149659c") : secret "samples-operator-tls" not found
Jun 02 01:53:13.346845 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:13.346812    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:13.347006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.346915    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:13.347006 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:13.346969    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.346954793 +0000 UTC m=+154.698974520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:14.720597 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:14.720507    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dwswb" event={"ID":"7c7b5ebc-d3df-41a4-9428-1f44a2c22518","Type":"ContainerStarted","Data":"5a78be4b764fc2328ee84409365622dbcc0d6783aac673feda6975f0fb3f61c3"}
Jun 02 01:53:14.721894 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:14.721857    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn" event={"ID":"80ada9d5-0ec0-43f1-a401-6fb94a3a4749","Type":"ContainerStarted","Data":"c7d3d657f2dd34b49e48bdced1443b51188c30aa62d165f78d30f6397d9ed8d8"}
Jun 02 01:53:14.735826 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:14.735777    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-dwswb" podStartSLOduration=1.2926473920000001 podStartE2EDuration="3.735760203s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:12.017630539 +0000 UTC m=+151.369650265" lastFinishedPulling="2026-06-02 01:53:14.460743349 +0000 UTC m=+153.812763076" observedRunningTime="2026-06-02 01:53:14.734996549 +0000 UTC m=+154.087016295" watchObservedRunningTime="2026-06-02 01:53:14.735760203 +0000 UTC m=+154.087779956"
Jun 02 01:53:14.748132 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:14.748089    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn" podStartSLOduration=1.2048164749999999 podStartE2EDuration="3.748075139s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:11.915527708 +0000 UTC m=+151.267547438" lastFinishedPulling="2026-06-02 01:53:14.458786371 +0000 UTC m=+153.810806102" observedRunningTime="2026-06-02 01:53:14.747924107 +0000 UTC m=+154.099943858" watchObservedRunningTime="2026-06-02 01:53:14.748075139 +0000 UTC m=+154.100094887"
Jun 02 01:53:15.162327 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:15.162283    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:15.162518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:15.162373    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:15.162518 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.162443    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 01:53:15.162627 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.162515    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:53:15.162627 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.162537    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b5df57-qzh7p: secret "image-registry-tls" not found
Jun 02 01:53:15.162627 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.162523    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls podName:bc359b41-33eb-48a1-91d8-5dd68149659c nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.162506548 +0000 UTC m=+158.514526279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6r4zt" (UID: "bc359b41-33eb-48a1-91d8-5dd68149659c") : secret "samples-operator-tls" not found
Jun 02 01:53:15.162627 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.162606    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls podName:ba55241b-0cb5-41df-95f7-2f4644e48c9d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.162590388 +0000 UTC m=+158.514610123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls") pod "image-registry-7869b5df57-qzh7p" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d") : secret "image-registry-tls" not found
Jun 02 01:53:15.364265 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:15.364228    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:15.364423 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.364333    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:15.364423 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:15.364414    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.364392816 +0000 UTC m=+158.716412547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:16.422202 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.422165    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"]
Jun 02 01:53:16.425391 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.425376    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"
Jun 02 01:53:16.427780 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.427758    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 02 01:53:16.427902 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.427758    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 02 01:53:16.428254 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.428239    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mwfjm\""
Jun 02 01:53:16.438410 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.438389    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"]
Jun 02 01:53:16.573987 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.573959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5zv\" (UniqueName: \"kubernetes.io/projected/b7fd9311-8af0-489d-95b0-4a01d5391bbf-kube-api-access-rq5zv\") pod \"migrator-96c6f749-stz44\" (UID: \"b7fd9311-8af0-489d-95b0-4a01d5391bbf\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"
Jun 02 01:53:16.674952 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.674859    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5zv\" (UniqueName: \"kubernetes.io/projected/b7fd9311-8af0-489d-95b0-4a01d5391bbf-kube-api-access-rq5zv\") pod \"migrator-96c6f749-stz44\" (UID: \"b7fd9311-8af0-489d-95b0-4a01d5391bbf\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"
Jun 02 01:53:16.682744 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.682713    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5zv\" (UniqueName: \"kubernetes.io/projected/b7fd9311-8af0-489d-95b0-4a01d5391bbf-kube-api-access-rq5zv\") pod \"migrator-96c6f749-stz44\" (UID: \"b7fd9311-8af0-489d-95b0-4a01d5391bbf\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"
Jun 02 01:53:16.734044 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.733991    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"
Jun 02 01:53:16.849926 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:16.849897    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-stz44"]
Jun 02 01:53:16.852631 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:16.852605    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fd9311_8af0_489d_95b0_4a01d5391bbf.slice/crio-0e34788d864dc92927d672336b9c7eec3f6707f64ecd97c5b05ab0478d04b563 WatchSource:0}: Error finding container 0e34788d864dc92927d672336b9c7eec3f6707f64ecd97c5b05ab0478d04b563: Status 404 returned error can't find the container with id 0e34788d864dc92927d672336b9c7eec3f6707f64ecd97c5b05ab0478d04b563
Jun 02 01:53:17.727412 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:17.727369    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44" event={"ID":"b7fd9311-8af0-489d-95b0-4a01d5391bbf","Type":"ContainerStarted","Data":"0e34788d864dc92927d672336b9c7eec3f6707f64ecd97c5b05ab0478d04b563"}
Jun 02 01:53:18.095675 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:18.095655    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lhz4g_0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84/dns-node-resolver/0.log"
Jun 02 01:53:18.732143 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:18.732112    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44" event={"ID":"b7fd9311-8af0-489d-95b0-4a01d5391bbf","Type":"ContainerStarted","Data":"07eef7e627660aba4a47ff51ba58b75b68b019bd3f33bd76215344145eeefc29"}
Jun 02 01:53:18.732143 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:18.732149    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44" event={"ID":"b7fd9311-8af0-489d-95b0-4a01d5391bbf","Type":"ContainerStarted","Data":"59b42e28d6243d876e1169e1904c1bfa24ff74546e62f32eb6d2d13c69a7eefb"}
Jun 02 01:53:18.747868 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:18.747816    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-stz44" podStartSLOduration=1.519530016 podStartE2EDuration="2.747802673s" podCreationTimestamp="2026-06-02 01:53:16 +0000 UTC" firstStartedPulling="2026-06-02 01:53:16.854377084 +0000 UTC m=+156.206396811" lastFinishedPulling="2026-06-02 01:53:18.082649726 +0000 UTC m=+157.434669468" observedRunningTime="2026-06-02 01:53:18.747657597 +0000 UTC m=+158.099677346" watchObservedRunningTime="2026-06-02 01:53:18.747802673 +0000 UTC m=+158.099822421"
Jun 02 01:53:18.897530 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:18.897507    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5lzzb_508a812b-d86e-4f50-a437-b605c2b433ee/node-ca/0.log"
Jun 02 01:53:19.051659 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.051567    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfxxl" podUID="eadbf4e3-85da-4def-ad0a-10806f3a7620"
Jun 02 01:53:19.070743 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.070709    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hcmq7" podUID="ac3dccf4-a0bf-4842-a256-886a277947bb"
Jun 02 01:53:19.195422 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:19.195366    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:19.195601 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:19.195459    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:19.195601 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.195519    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 02 01:53:19.195601 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.195597    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls podName:bc359b41-33eb-48a1-91d8-5dd68149659c nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.195576673 +0000 UTC m=+166.547596405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6r4zt" (UID: "bc359b41-33eb-48a1-91d8-5dd68149659c") : secret "samples-operator-tls" not found
Jun 02 01:53:19.195735 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.195632    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 02 01:53:19.195735 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.195653    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b5df57-qzh7p: secret "image-registry-tls" not found
Jun 02 01:53:19.195735 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.195709    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls podName:ba55241b-0cb5-41df-95f7-2f4644e48c9d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.19569259 +0000 UTC m=+166.547712337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls") pod "image-registry-7869b5df57-qzh7p" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d") : secret "image-registry-tls" not found
Jun 02 01:53:19.397387 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:19.397353    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:19.397554 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.397477    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:19.397554 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:19.397530    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.397517406 +0000 UTC m=+166.749537133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:19.740045 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:19.739960    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:53:19.740045 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:19.739967    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:53:20.225278 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:20.225231    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-495wn" podUID="0b7ea8cb-95b7-4640-b843-efe09587073c"
Jun 02 01:53:23.932633 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:23.932602    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:53:23.933043 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:23.932651    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:53:23.933043 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:23.932744    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 02 01:53:23.933043 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:23.932746    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 02 01:53:23.933043 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:23.932794    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls podName:eadbf4e3-85da-4def-ad0a-10806f3a7620 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:25.932781703 +0000 UTC m=+285.284801430 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls") pod "dns-default-hfxxl" (UID: "eadbf4e3-85da-4def-ad0a-10806f3a7620") : secret "dns-default-metrics-tls" not found
Jun 02 01:53:23.933043 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:23.932807    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert podName:ac3dccf4-a0bf-4842-a256-886a277947bb nodeName:}" failed. No retries permitted until 2026-06-02 01:55:25.932801083 +0000 UTC m=+285.284820809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert") pod "ingress-canary-hcmq7" (UID: "ac3dccf4-a0bf-4842-a256-886a277947bb") : secret "canary-serving-cert" not found
Jun 02 01:53:27.261329 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.261289    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:27.261740 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.261353    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:27.263684 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.263661    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"image-registry-7869b5df57-qzh7p\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") " pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:27.263684 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.263673    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc359b41-33eb-48a1-91d8-5dd68149659c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6r4zt\" (UID: \"bc359b41-33eb-48a1-91d8-5dd68149659c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:27.296589 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.296562    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"
Jun 02 01:53:27.303238 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.303211    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:27.422889 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.422796    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt"]
Jun 02 01:53:27.440609 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.440576    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:53:27.443670 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:27.443613    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba55241b_0cb5_41df_95f7_2f4644e48c9d.slice/crio-4a216e1f314cb272e96afdc2d869c425af80b0f1e97d94c74e2b253b8d409bde WatchSource:0}: Error finding container 4a216e1f314cb272e96afdc2d869c425af80b0f1e97d94c74e2b253b8d409bde: Status 404 returned error can't find the container with id 4a216e1f314cb272e96afdc2d869c425af80b0f1e97d94c74e2b253b8d409bde
Jun 02 01:53:27.463345 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.463324    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:27.463450 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:27.463437    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 02 01:53:27.463497 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:53:27.463489    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert podName:bbbe9a16-49f7-4add-aa2d-0336c8019121 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:43.463473823 +0000 UTC m=+182.815493566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-trxxg" (UID: "bbbe9a16-49f7-4add-aa2d-0336c8019121") : secret "networking-console-plugin-cert" not found
Jun 02 01:53:27.761031 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.760998    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" event={"ID":"ba55241b-0cb5-41df-95f7-2f4644e48c9d","Type":"ContainerStarted","Data":"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"}
Jun 02 01:53:27.761229 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.761039    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" event={"ID":"ba55241b-0cb5-41df-95f7-2f4644e48c9d","Type":"ContainerStarted","Data":"4a216e1f314cb272e96afdc2d869c425af80b0f1e97d94c74e2b253b8d409bde"}
Jun 02 01:53:27.761229 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.761117    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:53:27.762055 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.762029    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt" event={"ID":"bc359b41-33eb-48a1-91d8-5dd68149659c","Type":"ContainerStarted","Data":"65cd6ed4c9959cd5bbd9ecfe9f01b97d52bce120683a71d3ad17e10d72b8d2f4"}
Jun 02 01:53:27.777755 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:27.777718    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" podStartSLOduration=16.777707076 podStartE2EDuration="16.777707076s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:53:27.777416807 +0000 UTC m=+167.129436556" watchObservedRunningTime="2026-06-02 01:53:27.777707076 +0000 UTC m=+167.129726819"
Jun 02 01:53:29.773177 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:29.773137    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt" event={"ID":"bc359b41-33eb-48a1-91d8-5dd68149659c","Type":"ContainerStarted","Data":"36f6e9f5ff38af6404554081510f69af1c759fa9023d2fad65cc8d4ad97d648c"}
Jun 02 01:53:29.773177 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:29.773175    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt" event={"ID":"bc359b41-33eb-48a1-91d8-5dd68149659c","Type":"ContainerStarted","Data":"d6e386549c723fa34b7b8729268efaf39ecbff4ae16f5f7ee4707f6d8aa28547"}
Jun 02 01:53:34.208267 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:34.208206    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:53:40.377487 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.377422    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6r4zt" podStartSLOduration=28.025008685 podStartE2EDuration="29.377402s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:27.456815554 +0000 UTC m=+166.808835284" lastFinishedPulling="2026-06-02 01:53:28.80920887 +0000 UTC m=+168.161228599" observedRunningTime="2026-06-02 01:53:29.786875942 +0000 UTC m=+169.138895691" watchObservedRunningTime="2026-06-02 01:53:40.377402 +0000 UTC m=+179.729421751"
Jun 02 01:53:40.378657 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.378636    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sdgnm"]
Jun 02 01:53:40.384903 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.384888    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.386885 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.386868    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 02 01:53:40.386987 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.386911    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 02 01:53:40.387459 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.387442    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r9ggs\""
Jun 02 01:53:40.395470 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.395444    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdgnm"]
Jun 02 01:53:40.396169 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.396150    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-48wzn"]
Jun 02 01:53:40.399808 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.399790    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:40.402035 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.402011    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 02 01:53:40.402275 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.402162    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 02 01:53:40.402505 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.402476    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2kcg8\""
Jun 02 01:53:40.410287 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.410266    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-48wzn"]
Jun 02 01:53:40.410963 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.410947    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:53:40.443653 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.443624    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"]
Jun 02 01:53:40.447421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.447406    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.463959 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.463937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljgp\" (UniqueName: \"kubernetes.io/projected/ee9631cf-8377-4ed6-81cd-ff79b08f19d0-kube-api-access-qljgp\") pod \"downloads-c65b8dc4b-48wzn\" (UID: \"ee9631cf-8377-4ed6-81cd-ff79b08f19d0\") " pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:40.464056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.463975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.464056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.463998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.464144 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.464087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xp7p\" (UniqueName: \"kubernetes.io/projected/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-api-access-8xp7p\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.464144 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.464112    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-data-volume\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.464210 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.464188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-crio-socket\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.470771 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.470741    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"]
Jun 02 01:53:40.565284 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565251    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-crio-socket\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-image-registry-private-configuration\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ee63f14-72b9-447c-bcb2-d4170d17738b-ca-trust-extracted\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565363    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qljgp\" (UniqueName: \"kubernetes.io/projected/ee9631cf-8377-4ed6-81cd-ff79b08f19d0-kube-api-access-qljgp\") pod \"downloads-c65b8dc4b-48wzn\" (UID: \"ee9631cf-8377-4ed6-81cd-ff79b08f19d0\") " pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565373    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-crio-socket\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-certificates\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565443 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-trusted-ca\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-bound-sa-token\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565513    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565532    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565564    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xp7p\" (UniqueName: \"kubernetes.io/projected/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-api-access-8xp7p\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565582    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-data-volume\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.565660 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-installation-pull-secrets\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565867 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdg8j\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-kube-api-access-tdg8j\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565867 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-tls\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.565938 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.565917    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-data-volume\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.566156 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.566137    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.567731 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.567713    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.578524 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.578498    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xp7p\" (UniqueName: \"kubernetes.io/projected/f48eb265-b1d8-4d60-a59c-5cf2a11e8821-kube-api-access-8xp7p\") pod \"insights-runtime-extractor-sdgnm\" (UID: \"f48eb265-b1d8-4d60-a59c-5cf2a11e8821\") " pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.578784 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.578768    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljgp\" (UniqueName: \"kubernetes.io/projected/ee9631cf-8377-4ed6-81cd-ff79b08f19d0-kube-api-access-qljgp\") pod \"downloads-c65b8dc4b-48wzn\" (UID: \"ee9631cf-8377-4ed6-81cd-ff79b08f19d0\") " pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:40.666483 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666460    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdg8j\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-kube-api-access-tdg8j\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666499    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-tls\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666530    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-image-registry-private-configuration\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666552    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ee63f14-72b9-447c-bcb2-d4170d17738b-ca-trust-extracted\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666585    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-certificates\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666600    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-trusted-ca\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666642 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666618    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-bound-sa-token\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.666970 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.666657    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-installation-pull-secrets\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.667234 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.667165    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ee63f14-72b9-447c-bcb2-d4170d17738b-ca-trust-extracted\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.667540 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.667520    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-certificates\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.667741 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.667715    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ee63f14-72b9-447c-bcb2-d4170d17738b-trusted-ca\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.668898 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.668880    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-registry-tls\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.669011 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.668992    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-image-registry-private-configuration\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.669069 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.669054    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ee63f14-72b9-447c-bcb2-d4170d17738b-installation-pull-secrets\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.674097 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.674054    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-bound-sa-token\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.674400 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.674373    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdg8j\" (UniqueName: \"kubernetes.io/projected/3ee63f14-72b9-447c-bcb2-d4170d17738b-kube-api-access-tdg8j\") pod \"image-registry-5b9cfbffb4-dvbl5\" (UID: \"3ee63f14-72b9-447c-bcb2-d4170d17738b\") " pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.693153 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.693134    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdgnm"
Jun 02 01:53:40.708944 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.708923    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:40.755163 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.755127    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:40.830096 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.830068    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdgnm"]
Jun 02 01:53:40.833653 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:40.833625    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48eb265_b1d8_4d60_a59c_5cf2a11e8821.slice/crio-c9f952a2efeddbe133ee84c0e665f6a66b74b1bfe6a3d2491330b56bb893c527 WatchSource:0}: Error finding container c9f952a2efeddbe133ee84c0e665f6a66b74b1bfe6a3d2491330b56bb893c527: Status 404 returned error can't find the container with id c9f952a2efeddbe133ee84c0e665f6a66b74b1bfe6a3d2491330b56bb893c527
Jun 02 01:53:40.846030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.846000    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-48wzn"]
Jun 02 01:53:40.849155 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:40.849125    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9631cf_8377_4ed6_81cd_ff79b08f19d0.slice/crio-6572e34c4ce5b9eaa74b2e1af1e60c847349fc765a549f7094ecdddadb34a823 WatchSource:0}: Error finding container 6572e34c4ce5b9eaa74b2e1af1e60c847349fc765a549f7094ecdddadb34a823: Status 404 returned error can't find the container with id 6572e34c4ce5b9eaa74b2e1af1e60c847349fc765a549f7094ecdddadb34a823
Jun 02 01:53:40.891729 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:40.891702    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"]
Jun 02 01:53:40.895175 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:40.895147    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee63f14_72b9_447c_bcb2_d4170d17738b.slice/crio-1933a459cd74f811204a211adffa2e70063def367468fb0976b4163871c0acbc WatchSource:0}: Error finding container 1933a459cd74f811204a211adffa2e70063def367468fb0976b4163871c0acbc: Status 404 returned error can't find the container with id 1933a459cd74f811204a211adffa2e70063def367468fb0976b4163871c0acbc
Jun 02 01:53:41.806759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.806672    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-48wzn" event={"ID":"ee9631cf-8377-4ed6-81cd-ff79b08f19d0","Type":"ContainerStarted","Data":"6572e34c4ce5b9eaa74b2e1af1e60c847349fc765a549f7094ecdddadb34a823"}
Jun 02 01:53:41.808651 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.808619    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdgnm" event={"ID":"f48eb265-b1d8-4d60-a59c-5cf2a11e8821","Type":"ContainerStarted","Data":"a59cc12a8c0cecb522301adaf15f21163e3dc7d1010b0005646708c7654cfad1"}
Jun 02 01:53:41.808794 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.808656    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdgnm" event={"ID":"f48eb265-b1d8-4d60-a59c-5cf2a11e8821","Type":"ContainerStarted","Data":"342fa58ec63ad5e9a3cd4c38182f4d970af9681439721a2c8d5e70cd86fe64b2"}
Jun 02 01:53:41.808794 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.808669    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdgnm" event={"ID":"f48eb265-b1d8-4d60-a59c-5cf2a11e8821","Type":"ContainerStarted","Data":"c9f952a2efeddbe133ee84c0e665f6a66b74b1bfe6a3d2491330b56bb893c527"}
Jun 02 01:53:41.810069 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.810046    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerStarted","Data":"2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4"}
Jun 02 01:53:41.810172 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.810074    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerStarted","Data":"1933a459cd74f811204a211adffa2e70063def367468fb0976b4163871c0acbc"}
Jun 02 01:53:41.810242 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.810203    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:53:41.829429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:41.829388    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podStartSLOduration=1.829377439 podStartE2EDuration="1.829377439s" podCreationTimestamp="2026-06-02 01:53:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:53:41.828197845 +0000 UTC m=+181.180217596" watchObservedRunningTime="2026-06-02 01:53:41.829377439 +0000 UTC m=+181.181397182"
Jun 02 01:53:43.497785 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.497747    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:43.500452 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.500406    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbbe9a16-49f7-4add-aa2d-0336c8019121-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-trxxg\" (UID: \"bbbe9a16-49f7-4add-aa2d-0336c8019121\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:43.688619 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.688591    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hxl6\""
Jun 02 01:53:43.697057 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.697033    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"
Jun 02 01:53:43.817871 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.817836    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdgnm" event={"ID":"f48eb265-b1d8-4d60-a59c-5cf2a11e8821","Type":"ContainerStarted","Data":"06add6182981f0cb3534c96b07b331d8b75f7589f633b1a821f22d6dc139b850"}
Jun 02 01:53:43.837881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.837855    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg"]
Jun 02 01:53:43.838959 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:43.838905    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sdgnm" podStartSLOduration=1.089338032 podStartE2EDuration="3.838888887s" podCreationTimestamp="2026-06-02 01:53:40 +0000 UTC" firstStartedPulling="2026-06-02 01:53:40.905270354 +0000 UTC m=+180.257290080" lastFinishedPulling="2026-06-02 01:53:43.654821208 +0000 UTC m=+183.006840935" observedRunningTime="2026-06-02 01:53:43.838004673 +0000 UTC m=+183.190024448" watchObservedRunningTime="2026-06-02 01:53:43.838888887 +0000 UTC m=+183.190908637"
Jun 02 01:53:43.840061 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:43.840036    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbe9a16_49f7_4add_aa2d_0336c8019121.slice/crio-436f01b09eb98d0808dc55936ada7ab71cc83de9c9548c37c78aba6699a371d5 WatchSource:0}: Error finding container 436f01b09eb98d0808dc55936ada7ab71cc83de9c9548c37c78aba6699a371d5: Status 404 returned error can't find the container with id 436f01b09eb98d0808dc55936ada7ab71cc83de9c9548c37c78aba6699a371d5
Jun 02 01:53:44.821509 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:44.821462    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg" event={"ID":"bbbe9a16-49f7-4add-aa2d-0336c8019121","Type":"ContainerStarted","Data":"436f01b09eb98d0808dc55936ada7ab71cc83de9c9548c37c78aba6699a371d5"}
Jun 02 01:53:45.825778 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:45.825747    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg" event={"ID":"bbbe9a16-49f7-4add-aa2d-0336c8019121","Type":"ContainerStarted","Data":"04a695eea4b536c67fe24b14d19e0bb263887a6be823cec4dbfa5a10d3664a4d"}
Jun 02 01:53:45.843470 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:45.843417    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-trxxg" podStartSLOduration=33.456295157 podStartE2EDuration="34.843404932s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:43.842558071 +0000 UTC m=+183.194577816" lastFinishedPulling="2026-06-02 01:53:45.229667864 +0000 UTC m=+184.581687591" observedRunningTime="2026-06-02 01:53:45.842252199 +0000 UTC m=+185.194271950" watchObservedRunningTime="2026-06-02 01:53:45.843404932 +0000 UTC m=+185.195424677"
Jun 02 01:53:50.416348 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:50.416307    2567 patch_prober.go:28] interesting pod/image-registry-7869b5df57-qzh7p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:53:50.416876 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:50.416383    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:53:51.573199 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.573166    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:53:51.577617 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.577590    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.580207 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.580186    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 02 01:53:51.580409 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.580384    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 02 01:53:51.580537 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.580431    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 02 01:53:51.580872 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.580852    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 02 01:53:51.580872 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.580859    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 02 01:53:51.581110 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.581090    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djqjw\""
Jun 02 01:53:51.588086 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.588063    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:53:51.668946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.668910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.669127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.668995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.669127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.669034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlww6\" (UniqueName: \"kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.669127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.669082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.669307 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.669166    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.669307 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.669208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770237 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770187    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770264    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlww6\" (UniqueName: \"kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770312    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770404 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770369    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770558 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770406    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.770558 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.770431    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.771064 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.771004    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.771201 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.771096    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.771377 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.771208    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.773454 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.773429    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.773576 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.773487    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.778848 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.778829    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlww6\" (UniqueName: \"kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6\") pod \"console-5968c664b9-qj7sm\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") " pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:51.889167 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:51.889086    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:53:53.552825 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.552791    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wv5p5"]
Jun 02 01:53:53.557340 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.557315    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.559603 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.559576    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 02 01:53:53.560727 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.560701    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 02 01:53:53.560848 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.560787    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 02 01:53:53.560848 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.560806    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xd8pq\""
Jun 02 01:53:53.561428 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.561348    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 02 01:53:53.561537 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.561476    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 02 01:53:53.561714 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.561696    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 02 01:53:53.686653 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-metrics-client-ca\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686823 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-textfile\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686823 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-sys\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznwz\" (UniqueName: \"kubernetes.io/projected/fcc723b7-20de-44d4-983c-4a4d0d38bff2-kube-api-access-bznwz\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-tls\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.686927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-root\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.687097 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-wtmp\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.687097 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.686974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788093 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788058    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-metrics-client-ca\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788285 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788133    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-textfile\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788285 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788174    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-sys\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788285 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788252    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bznwz\" (UniqueName: \"kubernetes.io/projected/fcc723b7-20de-44d4-983c-4a4d0d38bff2-kube-api-access-bznwz\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788458 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788299    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-tls\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788458 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788322    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788458 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788350    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-root\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788458 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788373    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-wtmp\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788458 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788420    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788708 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788511    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-sys\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788708 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-textfile\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788708 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788665    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-root\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788849 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788757    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-metrics-client-ca\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788928 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788910    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-wtmp\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.788967 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.788929    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.791000 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.790976    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-tls\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.791127 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.791111    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcc723b7-20de-44d4-983c-4a4d0d38bff2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.798369 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.798352    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznwz\" (UniqueName: \"kubernetes.io/projected/fcc723b7-20de-44d4-983c-4a4d0d38bff2-kube-api-access-bznwz\") pod \"node-exporter-wv5p5\" (UID: \"fcc723b7-20de-44d4-983c-4a4d0d38bff2\") " pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:53.868371 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:53.868296    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wv5p5"
Jun 02 01:53:55.575891 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.575850    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d865f9465-kntjr"]
Jun 02 01:53:55.580867 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.580846    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.583075 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583004    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bs78eaij3evlh\""
Jun 02 01:53:55.583075 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583057    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m8gzj\""
Jun 02 01:53:55.583279 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583074    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 02 01:53:55.583279 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583100    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 02 01:53:55.583279 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583083    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 02 01:53:55.583279 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583053    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 02 01:53:55.583511 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.583496    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 02 01:53:55.588173 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.588154    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d865f9465-kntjr"]
Jun 02 01:53:55.703498 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703498 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5m5v\" (UniqueName: \"kubernetes.io/projected/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-kube-api-access-r5m5v\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703738 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703738 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703738 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-metrics-client-ca\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703738 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703899 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.703899 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.703818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-grpc-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804426 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804390    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804622 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804442    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-grpc-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804691 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804639    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804691    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5m5v\" (UniqueName: \"kubernetes.io/projected/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-kube-api-access-r5m5v\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804729    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804846 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804753    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804846 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804790    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-metrics-client-ca\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.804944 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.804852    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.805746 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.805695    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-metrics-client-ca\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.807631 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.807584    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.807756 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.807686    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.807756 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.807725    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-grpc-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.808316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.808270    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.808316 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.808271    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.808595 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.808580    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-secret-thanos-querier-tls\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.833390 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.833331    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5m5v\" (UniqueName: \"kubernetes.io/projected/b89ecf48-fe8c-417d-b2b0-538a03dfbae6-kube-api-access-r5m5v\") pod \"thanos-querier-d865f9465-kntjr\" (UID: \"b89ecf48-fe8c-417d-b2b0-538a03dfbae6\") " pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:55.892599 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:55.892561    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:53:57.200826 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:57.200783    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc723b7_20de_44d4_983c_4a4d0d38bff2.slice/crio-670e05659f306dd3d4dc7cae0ec8e9f07ebbff3defd0cdfd1e4afef8a7c39cf2 WatchSource:0}: Error finding container 670e05659f306dd3d4dc7cae0ec8e9f07ebbff3defd0cdfd1e4afef8a7c39cf2: Status 404 returned error can't find the container with id 670e05659f306dd3d4dc7cae0ec8e9f07ebbff3defd0cdfd1e4afef8a7c39cf2
Jun 02 01:53:57.333337 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.333311    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:53:57.346749 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:57.346716    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef3e75b_24cd_4692_ab89_275f27826ac4.slice/crio-24e9128fe35df9350c1753ee00a382846f85cb0b5e818d231526992f38edcf2e WatchSource:0}: Error finding container 24e9128fe35df9350c1753ee00a382846f85cb0b5e818d231526992f38edcf2e: Status 404 returned error can't find the container with id 24e9128fe35df9350c1753ee00a382846f85cb0b5e818d231526992f38edcf2e
Jun 02 01:53:57.347832 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.347800    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d865f9465-kntjr"]
Jun 02 01:53:57.351204 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:53:57.351183    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89ecf48_fe8c_417d_b2b0_538a03dfbae6.slice/crio-597b68a510a9cc3d8b10ff97be20c9b921f75c203a35bf984bc1659010eef7a6 WatchSource:0}: Error finding container 597b68a510a9cc3d8b10ff97be20c9b921f75c203a35bf984bc1659010eef7a6: Status 404 returned error can't find the container with id 597b68a510a9cc3d8b10ff97be20c9b921f75c203a35bf984bc1659010eef7a6
Jun 02 01:53:57.859914 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.859852    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"597b68a510a9cc3d8b10ff97be20c9b921f75c203a35bf984bc1659010eef7a6"}
Jun 02 01:53:57.862172 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.862136    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5968c664b9-qj7sm" event={"ID":"6ef3e75b-24cd-4692-ab89-275f27826ac4","Type":"ContainerStarted","Data":"24e9128fe35df9350c1753ee00a382846f85cb0b5e818d231526992f38edcf2e"}
Jun 02 01:53:57.864974 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.864893    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-48wzn" event={"ID":"ee9631cf-8377-4ed6-81cd-ff79b08f19d0","Type":"ContainerStarted","Data":"abbc5d0c0203065f7ca027fc5bd276b59385c4a42bbc8bf88921470f4a8ced25"}
Jun 02 01:53:57.865637 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.865594    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:57.867156 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.867135    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wv5p5" event={"ID":"fcc723b7-20de-44d4-983c-4a4d0d38bff2","Type":"ContainerStarted","Data":"670e05659f306dd3d4dc7cae0ec8e9f07ebbff3defd0cdfd1e4afef8a7c39cf2"}
Jun 02 01:53:57.880997 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.880972    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-48wzn"
Jun 02 01:53:57.885820 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.885793    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65485857c6-pvgkf"]
Jun 02 01:53:57.888427 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.888323    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:57.891992 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.891782    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 02 01:53:57.892105 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.892076    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 02 01:53:57.893248 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.893096    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 02 01:53:57.893358 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.893297    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-48wzn" podStartSLOduration=1.4497829740000001 podStartE2EDuration="17.893279835s" podCreationTimestamp="2026-06-02 01:53:40 +0000 UTC" firstStartedPulling="2026-06-02 01:53:40.851568148 +0000 UTC m=+180.203587881" lastFinishedPulling="2026-06-02 01:53:57.295065011 +0000 UTC m=+196.647084742" observedRunningTime="2026-06-02 01:53:57.890771762 +0000 UTC m=+197.242791512" watchObservedRunningTime="2026-06-02 01:53:57.893279835 +0000 UTC m=+197.245299585"
Jun 02 01:53:57.893638 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.893620    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-s55oc6f9b66a\""
Jun 02 01:53:57.894333 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.893782    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 02 01:53:57.894333 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.893894    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lwpbs\""
Jun 02 01:53:57.900525 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:57.900485    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65485857c6-pvgkf"]
Jun 02 01:53:58.028880 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.028831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-client-certs\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029058 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.028902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/81d698e0-bfe0-4f7c-a66e-646efa80c67e-audit-log\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029058 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.028939    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-client-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029058 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.028987    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-metrics-server-audit-profiles\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029058 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.029026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.029062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-tls\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.029300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.029148    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6sc\" (UniqueName: \"kubernetes.io/projected/81d698e0-bfe0-4f7c-a66e-646efa80c67e-kube-api-access-tg6sc\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130388    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-metrics-server-audit-profiles\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130448    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130483    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-tls\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130563    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6sc\" (UniqueName: \"kubernetes.io/projected/81d698e0-bfe0-4f7c-a66e-646efa80c67e-kube-api-access-tg6sc\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130655    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-client-certs\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130690    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/81d698e0-bfe0-4f7c-a66e-646efa80c67e-audit-log\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.131266 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.130721    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-client-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.133742 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.133618    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/81d698e0-bfe0-4f7c-a66e-646efa80c67e-audit-log\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.135467 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.135420    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.136839 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.136803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-client-certs\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.137542 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.137489    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-client-ca-bundle\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.139059 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.139033    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/81d698e0-bfe0-4f7c-a66e-646efa80c67e-secret-metrics-server-tls\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.139900 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.139876    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/81d698e0-bfe0-4f7c-a66e-646efa80c67e-metrics-server-audit-profiles\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.147609 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.147586    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6sc\" (UniqueName: \"kubernetes.io/projected/81d698e0-bfe0-4f7c-a66e-646efa80c67e-kube-api-access-tg6sc\") pod \"metrics-server-65485857c6-pvgkf\" (UID: \"81d698e0-bfe0-4f7c-a66e-646efa80c67e\") " pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.203411 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.203324    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:53:58.566701 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.566647    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65485857c6-pvgkf"]
Jun 02 01:53:58.876409 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.875783    2567 generic.go:358] "Generic (PLEG): container finished" podID="fcc723b7-20de-44d4-983c-4a4d0d38bff2" containerID="117b9bf1653ed839aea7c3cc9a120dd3a2588229c5f85ae2044606de3e53d445" exitCode=0
Jun 02 01:53:58.876409 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.875873    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wv5p5" event={"ID":"fcc723b7-20de-44d4-983c-4a4d0d38bff2","Type":"ContainerDied","Data":"117b9bf1653ed839aea7c3cc9a120dd3a2588229c5f85ae2044606de3e53d445"}
Jun 02 01:53:58.879940 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:58.879706    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf" event={"ID":"81d698e0-bfe0-4f7c-a66e-646efa80c67e","Type":"ContainerStarted","Data":"13092ec5a825331be57850783c55e8855ae1a2d2d95f28a6e843dc9fc7fb10e7"}
Jun 02 01:53:59.809558 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.807345    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:53:59.850336 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.848922    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:53:59.850336 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.849121    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.854331 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.854173    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.860982    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zgvbb\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.861245    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.861545    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.861728    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.862019    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.862118    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7ml2805r6212f\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.862228    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.862749    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.863322    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 02 01:53:59.863693 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.863512    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 02 01:53:59.864358 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.863720    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 02 01:53:59.868356 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.868332    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 02 01:53:59.870527 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.870505    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 02 01:53:59.890137 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.890067    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wv5p5" event={"ID":"fcc723b7-20de-44d4-983c-4a4d0d38bff2","Type":"ContainerStarted","Data":"635396ec9c295b354380c1a160428c79d7c95f648f6546caab2e7def3306513f"}
Jun 02 01:53:59.890137 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.890109    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wv5p5" event={"ID":"fcc723b7-20de-44d4-983c-4a4d0d38bff2","Type":"ContainerStarted","Data":"97a84043d613381da5e10a250668ace4b015a0a173103ddc9fc51b4bfed61196"}
Jun 02 01:53:59.909426 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.909372    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wv5p5" podStartSLOduration=5.710535529 podStartE2EDuration="6.909354406s" podCreationTimestamp="2026-06-02 01:53:53 +0000 UTC" firstStartedPulling="2026-06-02 01:53:57.202591071 +0000 UTC m=+196.554610799" lastFinishedPulling="2026-06-02 01:53:58.401409944 +0000 UTC m=+197.753429676" observedRunningTime="2026-06-02 01:53:59.907852729 +0000 UTC m=+199.259872555" watchObservedRunningTime="2026-06-02 01:53:59.909354406 +0000 UTC m=+199.261374156"
Jun 02 01:53:59.953032 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.952995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953184 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953184 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953184 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953184 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tml8d\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953419 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953783 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953783 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953783 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953783 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.953783 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:53:59.954038 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:53:59.953773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055253 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055111    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055253 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055159    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055253 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055187    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055253 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055245    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055274    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055299    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055354    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tml8d\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055383    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055425    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055449    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055476    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055505    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.055566 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055558    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.056047 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.055600    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.058186    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.058537    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.058570    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.058644    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.058695    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.059802    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.060390    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.061252    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.062998 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.062199    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.064759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.064697    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.065206 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.065161    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.066859 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.066789    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.067805 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.067760    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.068536 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.068492    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.069087 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.069038    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.069301 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.069277    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.069988 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.069922    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.070646 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.070599    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.071180 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.071135    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.074403 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.072391    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.075425 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.075150    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.076484 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.076415    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tml8d\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d\") pod \"prometheus-k8s-0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.168515 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.168479    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:00.416918 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.416877    2567 patch_prober.go:28] interesting pod/image-registry-7869b5df57-qzh7p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:00.417096 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.416945    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:00.760321 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.760245    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:00.760321 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:00.760301    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:02.819440 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:02.819295    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:02.819440 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:02.819366    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:02.904190 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:02.904159    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"4ac629cdb67d0d0489a74ac081ea2d7dd8cb3c41d52acd620d7f6bcf49a04ec0"}
Jun 02 01:54:02.907032 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:02.906933    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf" event={"ID":"81d698e0-bfe0-4f7c-a66e-646efa80c67e","Type":"ContainerStarted","Data":"9ad3bea3d4b19fe0794252041daf71a6ff3dfa672526482e3ec04d5cfa25cb2e"}
Jun 02 01:54:02.907626 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:02.907605    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:54:03.911860 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.911820    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"f8b7b3b626bab7ed9f01d31f3b62016a28524363be4e6b293d737c9fa96cd880"}
Jun 02 01:54:03.911860 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.911862    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"2f8ffad592dee1aced075c773d561403073ba43825f206572576080c08ea9e70"}
Jun 02 01:54:03.913025 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.912996    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"46cd701d288ff4f54d480d584a018bb3b2d3bcb0a4573d6f3093b9abaa66ff18"}
Jun 02 01:54:03.914527 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.914505    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5968c664b9-qj7sm" event={"ID":"6ef3e75b-24cd-4692-ab89-275f27826ac4","Type":"ContainerStarted","Data":"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"}
Jun 02 01:54:03.931640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.931305    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf" podStartSLOduration=2.782738131 podStartE2EDuration="6.931290036s" podCreationTimestamp="2026-06-02 01:53:57 +0000 UTC" firstStartedPulling="2026-06-02 01:53:58.578541677 +0000 UTC m=+197.930561408" lastFinishedPulling="2026-06-02 01:54:02.727093586 +0000 UTC m=+202.079113313" observedRunningTime="2026-06-02 01:54:03.930842547 +0000 UTC m=+203.282862300" watchObservedRunningTime="2026-06-02 01:54:03.931290036 +0000 UTC m=+203.283309788"
Jun 02 01:54:03.950151 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:03.950096    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5968c664b9-qj7sm" podStartSLOduration=7.564580408 podStartE2EDuration="12.950078776s" podCreationTimestamp="2026-06-02 01:53:51 +0000 UTC" firstStartedPulling="2026-06-02 01:53:57.348941324 +0000 UTC m=+196.700961054" lastFinishedPulling="2026-06-02 01:54:02.734439695 +0000 UTC m=+202.086459422" observedRunningTime="2026-06-02 01:54:03.948186553 +0000 UTC m=+203.300206304" watchObservedRunningTime="2026-06-02 01:54:03.950078776 +0000 UTC m=+203.302098600"
Jun 02 01:54:04.920960 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:04.920924    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"5fad9c2920f945d61b24d27511d2d5494c1f0297975ac43cffffdb5757c5f5c9"}
Jun 02 01:54:04.921355 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:04.920969    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"2bebef8031002f965475db24aa45e21a3ff4f20c08e777e90f6356135d952fbf"}
Jun 02 01:54:04.922450 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:04.922423    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91" exitCode=0
Jun 02 01:54:04.922547 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:04.922519    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"}
Jun 02 01:54:05.431349 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.431300    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry" containerID="cri-o://3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77" gracePeriod=30
Jun 02 01:54:05.715463 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.715435    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:54:05.819042 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819004    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819254 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819065    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819254 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819110    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819254 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819152    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819424 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819253    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819424 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819282    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819424 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819315    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.819424 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.819344    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rhgb\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb\") pod \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\" (UID: \"ba55241b-0cb5-41df-95f7-2f4644e48c9d\") "
Jun 02 01:54:05.820945 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.820196    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:54:05.820945 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.820444    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:54:05.823040 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.822959    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:54:05.824731 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.824687    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb" (OuterVolumeSpecName: "kube-api-access-8rhgb") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "kube-api-access-8rhgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:54:05.825173 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.825128    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:54:05.825943 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.825895    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:54:05.826131 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.826098    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:54:05.831833 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.831210    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ba55241b-0cb5-41df-95f7-2f4644e48c9d" (UID: "ba55241b-0cb5-41df-95f7-2f4644e48c9d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:54:05.921061 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921024    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba55241b-0cb5-41df-95f7-2f4644e48c9d-ca-trust-extracted\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921061 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921062    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-certificates\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921078    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-bound-sa-token\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921093    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-installation-pull-secrets\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921107    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rhgb\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-kube-api-access-8rhgb\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921121    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba55241b-0cb5-41df-95f7-2f4644e48c9d-image-registry-private-configuration\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921137    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba55241b-0cb5-41df-95f7-2f4644e48c9d-trusted-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.921553 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.921150    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba55241b-0cb5-41df-95f7-2f4644e48c9d-registry-tls\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:54:05.929456 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.929401    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" event={"ID":"b89ecf48-fe8c-417d-b2b0-538a03dfbae6","Type":"ContainerStarted","Data":"7c63b7ac8ed44f9a950a06995797ed4ccbed027e7d9554b9b185ff4bd2d152e8"}
Jun 02 01:54:05.929682 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.929657    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:54:05.931267 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.931206    2567 generic.go:358] "Generic (PLEG): container finished" podID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerID="3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77" exitCode=0
Jun 02 01:54:05.931267 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.931256    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" event={"ID":"ba55241b-0cb5-41df-95f7-2f4644e48c9d","Type":"ContainerDied","Data":"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"}
Jun 02 01:54:05.931429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.931292    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p" event={"ID":"ba55241b-0cb5-41df-95f7-2f4644e48c9d","Type":"ContainerDied","Data":"4a216e1f314cb272e96afdc2d869c425af80b0f1e97d94c74e2b253b8d409bde"}
Jun 02 01:54:05.931429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.931304    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b5df57-qzh7p"
Jun 02 01:54:05.931429 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.931328    2567 scope.go:117] "RemoveContainer" containerID="3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"
Jun 02 01:54:05.945434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.941883    2567 scope.go:117] "RemoveContainer" containerID="3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"
Jun 02 01:54:05.945434 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:54:05.942281    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77\": container with ID starting with 3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77 not found: ID does not exist" containerID="3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"
Jun 02 01:54:05.945434 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.942315    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77"} err="failed to get container status \"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77\": rpc error: code = NotFound desc = could not find container \"3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77\": container with ID starting with 3ead81f4857ddacaa76936011c777b168e407e265b6a725e9d9565626ea9da77 not found: ID does not exist"
Jun 02 01:54:05.951239 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.951125    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr" podStartSLOduration=3.746696795 podStartE2EDuration="10.951108227s" podCreationTimestamp="2026-06-02 01:53:55 +0000 UTC" firstStartedPulling="2026-06-02 01:53:57.35337956 +0000 UTC m=+196.705399286" lastFinishedPulling="2026-06-02 01:54:04.557790976 +0000 UTC m=+203.909810718" observedRunningTime="2026-06-02 01:54:05.948653717 +0000 UTC m=+205.300673468" watchObservedRunningTime="2026-06-02 01:54:05.951108227 +0000 UTC m=+205.303127977"
Jun 02 01:54:05.961702 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.961675    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:54:05.965012 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:05.964990    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7869b5df57-qzh7p"]
Jun 02 01:54:07.212019 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:07.211984    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" path="/var/lib/kubelet/pods/ba55241b-0cb5-41df-95f7-2f4644e48c9d/volumes"
Jun 02 01:54:08.944570 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:08.944536    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"}
Jun 02 01:54:08.944570 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:08.944574    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"}
Jun 02 01:54:08.945016 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:08.944584    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"}
Jun 02 01:54:08.945016 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:08.944592    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"}
Jun 02 01:54:08.945016 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:08.944600    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"}
Jun 02 01:54:09.949648 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:09.949611    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerStarted","Data":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"}
Jun 02 01:54:09.975542 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:09.975490    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.5523895880000005 podStartE2EDuration="10.97547272s" podCreationTimestamp="2026-06-02 01:53:59 +0000 UTC" firstStartedPulling="2026-06-02 01:54:02.911758348 +0000 UTC m=+202.263778075" lastFinishedPulling="2026-06-02 01:54:08.334841468 +0000 UTC m=+207.686861207" observedRunningTime="2026-06-02 01:54:09.974144532 +0000 UTC m=+209.326164281" watchObservedRunningTime="2026-06-02 01:54:09.97547272 +0000 UTC m=+209.327492467"
Jun 02 01:54:10.169577 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:10.169542    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:54:10.759741 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:10.759708    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:10.759917 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:10.759765    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:11.889606 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:11.889573    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:54:11.889606 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:11.889609    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:54:11.890946 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:11.890927    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:54:11.890996 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:11.890970    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:54:11.941963 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:11.941938    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d865f9465-kntjr"
Jun 02 01:54:12.817240 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:12.817196    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:12.817423 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:12.817257    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:18.204226 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:18.204191    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:54:18.204695 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:18.204282    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:54:20.759802 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.759763    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:20.760181 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.759813    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:20.760181 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.759850    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:54:20.760284 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.760267    2567 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4"} pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 02 01:54:20.763402 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.763373    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:20.763516 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.763416    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:20.982260 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.982198    2567 generic.go:358] "Generic (PLEG): container finished" podID="80ada9d5-0ec0-43f1-a401-6fb94a3a4749" containerID="c7d3d657f2dd34b49e48bdced1443b51188c30aa62d165f78d30f6397d9ed8d8" exitCode=0
Jun 02 01:54:20.982421 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.982279    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn" event={"ID":"80ada9d5-0ec0-43f1-a401-6fb94a3a4749","Type":"ContainerDied","Data":"c7d3d657f2dd34b49e48bdced1443b51188c30aa62d165f78d30f6397d9ed8d8"}
Jun 02 01:54:20.982603 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:20.982589    2567 scope.go:117] "RemoveContainer" containerID="c7d3d657f2dd34b49e48bdced1443b51188c30aa62d165f78d30f6397d9ed8d8"
Jun 02 01:54:21.890273 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:21.890240    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:54:21.890629 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:21.890293    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:54:21.986392 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:21.986362    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-49qwn" event={"ID":"80ada9d5-0ec0-43f1-a401-6fb94a3a4749","Type":"ContainerStarted","Data":"2acd5d6150b973c400936d4789fcfc22322fab5d071d056722ce0c251dd6766c"}
Jun 02 01:54:25.999799 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:25.999714    2567 generic.go:358] "Generic (PLEG): container finished" podID="7c7b5ebc-d3df-41a4-9428-1f44a2c22518" containerID="5a78be4b764fc2328ee84409365622dbcc0d6783aac673feda6975f0fb3f61c3" exitCode=0
Jun 02 01:54:25.999799 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:25.999769    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dwswb" event={"ID":"7c7b5ebc-d3df-41a4-9428-1f44a2c22518","Type":"ContainerDied","Data":"5a78be4b764fc2328ee84409365622dbcc0d6783aac673feda6975f0fb3f61c3"}
Jun 02 01:54:26.000322 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:26.000240    2567 scope.go:117] "RemoveContainer" containerID="5a78be4b764fc2328ee84409365622dbcc0d6783aac673feda6975f0fb3f61c3"
Jun 02 01:54:27.004309 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:27.004272    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dwswb" event={"ID":"7c7b5ebc-d3df-41a4-9428-1f44a2c22518","Type":"ContainerStarted","Data":"0d55d6a57a4c9b2994d6f3009e6087106601e7eb1dfddcdc9f2f673f03a05cc2"}
Jun 02 01:54:30.763853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:30.763813    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:30.764332 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:30.763879    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:31.133588 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:31.133503    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65485857c6-pvgkf_81d698e0-bfe0-4f7c-a66e-646efa80c67e/metrics-server/0.log"
Jun 02 01:54:31.890356 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:31.890319    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:54:31.890737 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:31.890370    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:54:32.733413 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:32.733385    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/init-textfile/0.log"
Jun 02 01:54:32.933399 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:32.933366    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/node-exporter/0.log"
Jun 02 01:54:33.133140 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:33.133057    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/kube-rbac-proxy/0.log"
Jun 02 01:54:33.942293 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:33.942267    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/init-config-reloader/0.log"
Jun 02 01:54:34.135152 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:34.135119    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/prometheus/0.log"
Jun 02 01:54:34.332452 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:34.332377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/config-reloader/0.log"
Jun 02 01:54:34.532580 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:34.532537    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/thanos-sidecar/0.log"
Jun 02 01:54:34.732773 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:34.732742    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/kube-rbac-proxy-web/0.log"
Jun 02 01:54:34.931770 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:34.931746    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/kube-rbac-proxy/0.log"
Jun 02 01:54:35.132629 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:35.132550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_689dd191-251b-4160-9792-8e7ba83b25a0/kube-rbac-proxy-thanos/0.log"
Jun 02 01:54:35.933138 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:35.933104    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/thanos-query/0.log"
Jun 02 01:54:36.132267 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:36.132233    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-web/0.log"
Jun 02 01:54:36.332697 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:36.332608    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy/0.log"
Jun 02 01:54:36.531872 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:36.531843    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/prom-label-proxy/0.log"
Jun 02 01:54:36.732980 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:36.732954    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-rules/0.log"
Jun 02 01:54:36.932907 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:36.932878    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-metrics/0.log"
Jun 02 01:54:37.133352 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:37.133268    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-trxxg_bbbe9a16-49f7-4add-aa2d-0336c8019121/networking-console-plugin/0.log"
Jun 02 01:54:37.732825 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:37.732801    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5968c664b9-qj7sm_6ef3e75b-24cd-4692-ab89-275f27826ac4/console/0.log"
Jun 02 01:54:38.135011 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:38.134929    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-48wzn_ee9631cf-8377-4ed6-81cd-ff79b08f19d0/download-server/0.log"
Jun 02 01:54:38.209720 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:38.209688    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:54:38.213460 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:38.213438    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65485857c6-pvgkf"
Jun 02 01:54:39.731976 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:39.731947    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lhz4g_0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84/dns-node-resolver/0.log"
Jun 02 01:54:40.133604 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:40.133534    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9cfbffb4-dvbl5_3ee63f14-72b9-447c-bcb2-d4170d17738b/registry/0.log"
Jun 02 01:54:40.532673 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:40.532645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5lzzb_508a812b-d86e-4f50-a437-b605c2b433ee/node-ca/0.log"
Jun 02 01:54:40.764017 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:40.763984    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:54:40.764473 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:40.764033    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:54:41.889907 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:41.889876    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:54:41.890370 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:41.889952    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:54:45.779402 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:45.779359    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" containerID="cri-o://2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4" gracePeriod=30
Jun 02 01:54:47.065770 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:47.065737    2567 generic.go:358] "Generic (PLEG): container finished" podID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerID="2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4" exitCode=0
Jun 02 01:54:47.066185 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:47.065783    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerDied","Data":"2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4"}
Jun 02 01:54:47.066185 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:47.065809    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerStarted","Data":"47abeee099998f06f979620a2388cfd989fcea19516058935f3f43ca2529cf4e"}
Jun 02 01:54:47.066185 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:47.065983    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:54:51.890345 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:51.890307    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:54:51.890796 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:51.890373    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:54:53.040968 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:53.040936    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:54:53.043272 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:53.043251    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ea8cb-95b7-4640-b843-efe09587073c-metrics-certs\") pod \"network-metrics-daemon-495wn\" (UID: \"0b7ea8cb-95b7-4640-b843-efe09587073c\") " pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:54:53.111779 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:53.111752    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\""
Jun 02 01:54:53.119547 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:53.119527    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-495wn"
Jun 02 01:54:53.250690 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:53.250665    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-495wn"]
Jun 02 01:54:53.252033 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:54:53.252000    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7ea8cb_95b7_4640_b843_efe09587073c.slice/crio-294fe326f4b2d420cdffbc0dfb09075ee7d05cb97238108d35cf29750b651547 WatchSource:0}: Error finding container 294fe326f4b2d420cdffbc0dfb09075ee7d05cb97238108d35cf29750b651547: Status 404 returned error can't find the container with id 294fe326f4b2d420cdffbc0dfb09075ee7d05cb97238108d35cf29750b651547
Jun 02 01:54:54.088966 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:54.088928    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-495wn" event={"ID":"0b7ea8cb-95b7-4640-b843-efe09587073c","Type":"ContainerStarted","Data":"294fe326f4b2d420cdffbc0dfb09075ee7d05cb97238108d35cf29750b651547"}
Jun 02 01:54:55.093175 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:55.093138    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-495wn" event={"ID":"0b7ea8cb-95b7-4640-b843-efe09587073c","Type":"ContainerStarted","Data":"c61d6043dcd239b49088b6079348852a22b3f6f5de8f34e469052d109f71d3c3"}
Jun 02 01:54:55.093175 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:55.093177    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-495wn" event={"ID":"0b7ea8cb-95b7-4640-b843-efe09587073c","Type":"ContainerStarted","Data":"aaac3633eba729c27e12b961ebf716d1b407c599b416d642dec7723032f93537"}
Jun 02 01:54:55.109523 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:54:55.109479    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-495wn" podStartSLOduration=253.06868588 podStartE2EDuration="4m14.109465406s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:54:53.253949496 +0000 UTC m=+252.605969237" lastFinishedPulling="2026-06-02 01:54:54.294729037 +0000 UTC m=+253.646748763" observedRunningTime="2026-06-02 01:54:55.107662477 +0000 UTC m=+254.459682264" watchObservedRunningTime="2026-06-02 01:54:55.109465406 +0000 UTC m=+254.461485191"
Jun 02 01:55:00.170085 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:00.169996    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:00.188979 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:00.188953    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:00.760183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:00.760147    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:00.760357 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:00.760201    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:01.125582 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:01.125502    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:01.890466 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:01.890429    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:55:01.890843 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:01.890494    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:55:08.072865 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:08.072831    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:08.073269 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:08.072895    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:10.759310 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:10.759277    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:10.759762 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:10.759343    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:11.889831 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:11.889794    2567 patch_prober.go:28] interesting pod/console-5968c664b9-qj7sm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jun 02 01:55:11.890201 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:11.889847    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jun 02 01:55:18.072130 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.072087    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:18.072598 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.072148    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:18.472588 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.472557    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:18.473056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.472989    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="prometheus" containerID="cri-o://b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119" gracePeriod=600
Jun 02 01:55:18.473056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.473007    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94" gracePeriod=600
Jun 02 01:55:18.473056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.472996    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-web" containerID="cri-o://cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366" gracePeriod=600
Jun 02 01:55:18.473268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.473045    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="config-reloader" containerID="cri-o://4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f" gracePeriod=600
Jun 02 01:55:18.473268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.473032    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy" containerID="cri-o://ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f" gracePeriod=600
Jun 02 01:55:18.473268 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.473013    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="thanos-sidecar" containerID="cri-o://e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76" gracePeriod=600
Jun 02 01:55:18.707936 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.707913    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:18.867721 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867634    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.867721 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867665    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tml8d\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.867721 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867685    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.867721 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867714    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867747    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867777    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867810    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867844    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867902    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867927    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867966    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.867996    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868031    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868056    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868109    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868143    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868167    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868189    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db\") pod \"689dd191-251b-4160-9792-8e7ba83b25a0\" (UID: \"689dd191-251b-4160-9792-8e7ba83b25a0\") "
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868181    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868366    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868492    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.868518 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.868512    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.869833 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.869802    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:55:18.870013 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.869842    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:18.870136 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.870107    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:18.870696 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.870668    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:18.870793 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.870738    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.870793 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.870755    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config" (OuterVolumeSpecName: "config") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.870906 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.870807    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.871482 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.871445    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.872006 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.871967    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.872109 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.872040    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.872480 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.872452    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:55:18.872732 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.872708    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.872732 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.872718    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d" (OuterVolumeSpecName: "kube-api-access-tml8d") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "kube-api-access-tml8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:55:18.872881 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.872817    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out" (OuterVolumeSpecName: "config-out") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 02 01:55:18.873573 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.873553    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.882126 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.882102    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config" (OuterVolumeSpecName: "web-config") pod "689dd191-251b-4160-9792-8e7ba83b25a0" (UID: "689dd191-251b-4160-9792-8e7ba83b25a0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:18.969713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969671    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-kube-rbac-proxy\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969709    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969721    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-metrics-client-certs\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969730    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-metrics-client-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969739    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969747    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-web-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969757    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-config-out\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969765    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969774    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969783    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969791    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-grpc-tls\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969799    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/689dd191-251b-4160-9792-8e7ba83b25a0-prometheus-k8s-db\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969807    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tml8d\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-kube-api-access-tml8d\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969815    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969824    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/689dd191-251b-4160-9792-8e7ba83b25a0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:18.969927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:18.969833    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/689dd191-251b-4160-9792-8e7ba83b25a0-tls-assets\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:19.168933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168902    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94" exitCode=0
Jun 02 01:55:19.168933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168929    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f" exitCode=0
Jun 02 01:55:19.168933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168940    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366" exitCode=0
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168948    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76" exitCode=0
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168959    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f" exitCode=0
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168966    2567 generic.go:358] "Generic (PLEG): container finished" podID="689dd191-251b-4160-9792-8e7ba83b25a0" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119" exitCode=0
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168983    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169023    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169037    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169047    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169056    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.168996    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169076    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169067    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"}
Jun 02 01:55:19.169453 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.169174    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"689dd191-251b-4160-9792-8e7ba83b25a0","Type":"ContainerDied","Data":"46cd701d288ff4f54d480d584a018bb3b2d3bcb0a4573d6f3093b9abaa66ff18"}
Jun 02 01:55:19.177148 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.177133    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.183594 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.183578    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.189631 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.189613    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.192481 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.192459    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:19.196426 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.196410    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.199069 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.199045    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:19.203043 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.203023    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.213588 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.213558    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.215666 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.215641    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" path="/var/lib/kubelet/pods/689dd191-251b-4160-9792-8e7ba83b25a0/volumes"
Jun 02 01:55:19.220035 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220019    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.220305 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.220281    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.220395 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220317    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.220395 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220342    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.220578 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.220561    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.220621 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220584    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.220621 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220598    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.220813 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.220794    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.220813 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220811    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.220954 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.220822    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.221017 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.221001    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.221056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221021    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.221056 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221035    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.221296 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.221272    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.221370 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221302    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.221370 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221321    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.221534 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.221516    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.221575 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221539    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.221575 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221551    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.221766 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:19.221748    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.221812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221768    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.221812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221780    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.221974 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221958    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.222017 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.221975    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.222176 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222159    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.222176 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222176    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.222378 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222362    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.222422 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222378    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.222565 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222548    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.222565 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222564    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.222736 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222721    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.222780 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222736    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.222933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222916    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.222933 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.222933    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.223111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223096    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.223111 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223110    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.223318 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223300    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.223371 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223319    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.223494 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223479    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.223540 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223493    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.223677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223663    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.223677 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223676    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.223841 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223824    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.223885 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223841    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.224006 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.223991    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.224006 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224005    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.224153 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224138    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.224191 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224152    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.224359 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224346    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.224414 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224361    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.224561 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224545    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.224561 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224560    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.224759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224732    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.224810 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224760    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.224978 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224961    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.225018 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.224979    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.225196 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225150    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.225196 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225175    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.225416 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225402    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.225486 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225417    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.225694 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225670    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.225694 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225693    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.225927 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.225895    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.226030 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.226012    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.226417 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.226341    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.226417 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.226393    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.226778 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.226750    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.226778 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.226778    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.227036 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227010    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.227036 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227031    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.227295 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227274    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.227295 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227296    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.227417 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227385    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:19.227525 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227508    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.227580 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227525    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.227733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227715    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="init-config-reloader"
Jun 02 01:55:19.227733 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227732    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="init-config-reloader"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227740    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227745    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227742    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227768    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227753    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="config-reloader"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227825    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="config-reloader"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227839    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="thanos-sidecar"
Jun 02 01:55:19.227857 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227848    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="thanos-sidecar"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227862    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="prometheus"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227871    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="prometheus"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227915    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-web"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227926    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-web"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227937    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227945    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227966    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-thanos"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227974    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-thanos"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.227996    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228017    2567 scope.go:117] "RemoveContainer" containerID="1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228054    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="prometheus"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228066    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="config-reloader"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228077    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba55241b-0cb5-41df-95f7-2f4644e48c9d" containerName="registry"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228087    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228097    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-web"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228106    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="thanos-sidecar"
Jun 02 01:55:19.228134 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228117    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="689dd191-251b-4160-9792-8e7ba83b25a0" containerName="kube-rbac-proxy-thanos"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228261    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94"} err="failed to get container status \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": rpc error: code = NotFound desc = could not find container \"1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94\": container with ID starting with 1e9b15667161d5abe92956be3e933ff96747d1d9d6b04b1cf1f434d9245fcc94 not found: ID does not exist"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228275    2567 scope.go:117] "RemoveContainer" containerID="ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228517    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f"} err="failed to get container status \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": rpc error: code = NotFound desc = could not find container \"ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f\": container with ID starting with ad2698eae8dba515c967bdbbd5e412f2ce60078af65864cd733de471bd702d0f not found: ID does not exist"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228543    2567 scope.go:117] "RemoveContainer" containerID="cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228704    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366"} err="failed to get container status \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": rpc error: code = NotFound desc = could not find container \"cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366\": container with ID starting with cfb449e10479e2819fd534618dce5003a04344a59131978a547dfb4c2fae8366 not found: ID does not exist"
Jun 02 01:55:19.228842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228720    2567 scope.go:117] "RemoveContainer" containerID="e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"
Jun 02 01:55:19.229089 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228895    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76"} err="failed to get container status \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": rpc error: code = NotFound desc = could not find container \"e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76\": container with ID starting with e5542545b085e82a883d26e56609571f2917273435d8083370c72561a99b0d76 not found: ID does not exist"
Jun 02 01:55:19.229089 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.228908    2567 scope.go:117] "RemoveContainer" containerID="4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"
Jun 02 01:55:19.229155 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.229122    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f"} err="failed to get container status \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": rpc error: code = NotFound desc = could not find container \"4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f\": container with ID starting with 4c1471644df8ae0593cd9b202bae86ae057e186c6864a2d203bb2263b001c77f not found: ID does not exist"
Jun 02 01:55:19.229155 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.229139    2567 scope.go:117] "RemoveContainer" containerID="b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"
Jun 02 01:55:19.229377 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.229359    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119"} err="failed to get container status \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": rpc error: code = NotFound desc = could not find container \"b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119\": container with ID starting with b6ac187093551f81e33f781cac13428959bbbb1d470332ff17a1883b2c748119 not found: ID does not exist"
Jun 02 01:55:19.229446 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.229379    2567 scope.go:117] "RemoveContainer" containerID="00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"
Jun 02 01:55:19.229573 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.229558    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91"} err="failed to get container status \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": rpc error: code = NotFound desc = could not find container \"00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91\": container with ID starting with 00f6d1b707ccb2732102512829566aeddb042e4accca20f84d260c24d02faf91 not found: ID does not exist"
Jun 02 01:55:19.231955 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.231942    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.235300 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.235273    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 02 01:55:19.235632 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.235614    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zgvbb\""
Jun 02 01:55:19.235985 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.235967    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 02 01:55:19.236129 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236022    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 02 01:55:19.236129 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236035    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 02 01:55:19.236129 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236081    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 02 01:55:19.236129 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236035    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 02 01:55:19.236327 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236162    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 02 01:55:19.236487 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236471    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 02 01:55:19.236538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236472    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7ml2805r6212f\""
Jun 02 01:55:19.236597 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.236583    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 02 01:55:19.238088 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.238074    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 02 01:55:19.242547 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.242529    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 02 01:55:19.242624 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.242584    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 02 01:55:19.247558 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.247538    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:19.372907 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.372874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373073 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.372914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373073 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.372933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373073 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373073 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config-out\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7w78\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-kube-api-access-g7w78\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373203 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373238    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-web-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373396 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.373573 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.373406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474506    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474550    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474567    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config-out\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474584    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474706    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474739    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w78\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-kube-api-access-g7w78\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474767    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474800    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.474853 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474829    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-web-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474857    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474904    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474941    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.474976    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475002    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475031    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475059    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475092 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475087    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475164    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.475528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.475399    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.476387 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.476358    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.477364 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.477336    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config-out\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.478097 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.477794    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.478097 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478054    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.478420 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478337    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.478420 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478346    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.478420 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478334    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-web-config\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.479098 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.479098 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.478954    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.479098 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.479024    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd8c9b1-7490-48eb-95f3-9ea53135c206-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.479295 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.479263    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.479847 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.479825    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.480206 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.480187    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.480709 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.480686    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.480850 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.480834    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.481183 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.481163    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4cd8c9b1-7490-48eb-95f3-9ea53135c206-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.483319 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.483299    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7w78\" (UniqueName: \"kubernetes.io/projected/4cd8c9b1-7490-48eb-95f3-9ea53135c206-kube-api-access-g7w78\") pod \"prometheus-k8s-0\" (UID: \"4cd8c9b1-7490-48eb-95f3-9ea53135c206\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.541444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.541402    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:19.673876 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:19.673851    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 02 01:55:19.675663 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:55:19.675638    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd8c9b1_7490_48eb_95f3_9ea53135c206.slice/crio-13224462d8236ffcd0858565fa7ba90a893b24c179bafe9dd7c3a222f5e9c001 WatchSource:0}: Error finding container 13224462d8236ffcd0858565fa7ba90a893b24c179bafe9dd7c3a222f5e9c001: Status 404 returned error can't find the container with id 13224462d8236ffcd0858565fa7ba90a893b24c179bafe9dd7c3a222f5e9c001
Jun 02 01:55:20.174041 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.174010    2567 generic.go:358] "Generic (PLEG): container finished" podID="4cd8c9b1-7490-48eb-95f3-9ea53135c206" containerID="096fdd73a50b206b2b58fe43a50cbecdde11e5a7e43eb869b02e4266407fab74" exitCode=0
Jun 02 01:55:20.174528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.174089    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerDied","Data":"096fdd73a50b206b2b58fe43a50cbecdde11e5a7e43eb869b02e4266407fab74"}
Jun 02 01:55:20.174528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.174109    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"13224462d8236ffcd0858565fa7ba90a893b24c179bafe9dd7c3a222f5e9c001"}
Jun 02 01:55:20.759093 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.759005    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:20.759093 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.759059    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:20.759311 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.759097    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:55:20.759548 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.759529    2567 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"47abeee099998f06f979620a2388cfd989fcea19516058935f3f43ca2529cf4e"} pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 02 01:55:20.762961 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.762935    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:20.763083 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:20.762978    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:21.181235 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181188    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"9a1146b282287f2eb102de2a2140819e3fd3bb9ba29fae7664370c86fbbcb843"}
Jun 02 01:55:21.181584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181241    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"16540efa768c54fb89e6ac0bbbf9869e7dc501e41835a6df9190d34ae33acde6"}
Jun 02 01:55:21.181584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181252    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"a9f5d3373807383105c69e4c6d052aaec049ceea520436a73f63ffceb82ff7e1"}
Jun 02 01:55:21.181584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181260    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"9a85e3b37533dddd74cefd5f275a7f7a6b619664103a5d83d2fb749092064a35"}
Jun 02 01:55:21.181584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181268    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"9755cd5f7ee529ba59a936df9a6bf6cde62cb774f45c57b1fb929d0c76f2fb6c"}
Jun 02 01:55:21.181584 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.181276    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4cd8c9b1-7490-48eb-95f3-9ea53135c206","Type":"ContainerStarted","Data":"319cbb68fc1dc0dc8477c9d39daaeeb444b7bf6684e38800bc5fb11a43e7eaba"}
Jun 02 01:55:21.239262 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.239204    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.239189633 podStartE2EDuration="2.239189633s" podCreationTimestamp="2026-06-02 01:55:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:55:21.236898637 +0000 UTC m=+280.588918385" watchObservedRunningTime="2026-06-02 01:55:21.239189633 +0000 UTC m=+280.591209383"
Jun 02 01:55:21.740120 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:21.740089    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:55:22.740741 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:22.740697    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hcmq7" podUID="ac3dccf4-a0bf-4842-a256-886a277947bb"
Jun 02 01:55:22.740741 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:22.740708    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfxxl" podUID="eadbf4e3-85da-4def-ad0a-10806f3a7620"
Jun 02 01:55:23.186502 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:23.186472    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:23.186661 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:23.186473    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:55:24.541856 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:24.541803    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:55:25.934407 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:25.934375    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:55:25.934894 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:25.934417    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:25.936752 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:25.936729    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eadbf4e3-85da-4def-ad0a-10806f3a7620-metrics-tls\") pod \"dns-default-hfxxl\" (UID: \"eadbf4e3-85da-4def-ad0a-10806f3a7620\") " pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:25.936850 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:25.936763    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac3dccf4-a0bf-4842-a256-886a277947bb-cert\") pod \"ingress-canary-hcmq7\" (UID: \"ac3dccf4-a0bf-4842-a256-886a277947bb\") " pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:55:26.190354 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.190274    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\""
Jun 02 01:55:26.190354 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.190275    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\""
Jun 02 01:55:26.198115 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.198094    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hcmq7"
Jun 02 01:55:26.198250 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.198120    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:26.343554 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.343529    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfxxl"]
Jun 02 01:55:26.346240 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:55:26.346195    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadbf4e3_85da_4def_ad0a_10806f3a7620.slice/crio-2086f803346be6f69086a91b085f87de73883ff63bcd26ae7c6561bfb0b465fe WatchSource:0}: Error finding container 2086f803346be6f69086a91b085f87de73883ff63bcd26ae7c6561bfb0b465fe: Status 404 returned error can't find the container with id 2086f803346be6f69086a91b085f87de73883ff63bcd26ae7c6561bfb0b465fe
Jun 02 01:55:26.357357 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:26.357315    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hcmq7"]
Jun 02 01:55:26.359300 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:55:26.359275    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3dccf4_a0bf_4842_a256_886a277947bb.slice/crio-5950d3ff4d2cb59771b06b83ec03df1dc3124a7bbaf9fabe55a6b0db72a99830 WatchSource:0}: Error finding container 5950d3ff4d2cb59771b06b83ec03df1dc3124a7bbaf9fabe55a6b0db72a99830: Status 404 returned error can't find the container with id 5950d3ff4d2cb59771b06b83ec03df1dc3124a7bbaf9fabe55a6b0db72a99830
Jun 02 01:55:27.202822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:27.202779    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hcmq7" event={"ID":"ac3dccf4-a0bf-4842-a256-886a277947bb","Type":"ContainerStarted","Data":"5950d3ff4d2cb59771b06b83ec03df1dc3124a7bbaf9fabe55a6b0db72a99830"}
Jun 02 01:55:27.204110 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:27.204065    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfxxl" event={"ID":"eadbf4e3-85da-4def-ad0a-10806f3a7620","Type":"ContainerStarted","Data":"2086f803346be6f69086a91b085f87de73883ff63bcd26ae7c6561bfb0b465fe"}
Jun 02 01:55:29.211773 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.211734    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfxxl" event={"ID":"eadbf4e3-85da-4def-ad0a-10806f3a7620","Type":"ContainerStarted","Data":"75014af6485c4bd5f5017638ab15ad0b631ba30b2f3c887b1f8cbeb57835aab3"}
Jun 02 01:55:29.211773 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.211776    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfxxl" event={"ID":"eadbf4e3-85da-4def-ad0a-10806f3a7620","Type":"ContainerStarted","Data":"8d0d9d2d75ce633871d99317606925ec3988d7b72aab8e6307c15e3eaf129965"}
Jun 02 01:55:29.212352 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.211852    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:29.213006 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.212980    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hcmq7" event={"ID":"ac3dccf4-a0bf-4842-a256-886a277947bb","Type":"ContainerStarted","Data":"41eb2e6a48c093ecf398e5401ce42d1e3681c4ec7809ab6e63039c1e4b25c092"}
Jun 02 01:55:29.254133 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.254089    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hfxxl" podStartSLOduration=252.405279036 podStartE2EDuration="4m14.25407517s" podCreationTimestamp="2026-06-02 01:51:15 +0000 UTC" firstStartedPulling="2026-06-02 01:55:26.347881322 +0000 UTC m=+285.699901052" lastFinishedPulling="2026-06-02 01:55:28.196677445 +0000 UTC m=+287.548697186" observedRunningTime="2026-06-02 01:55:29.25319373 +0000 UTC m=+288.605213470" watchObservedRunningTime="2026-06-02 01:55:29.25407517 +0000 UTC m=+288.606094973"
Jun 02 01:55:29.282647 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:29.282607    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hcmq7" podStartSLOduration=252.442108394 podStartE2EDuration="4m14.28259556s" podCreationTimestamp="2026-06-02 01:51:15 +0000 UTC" firstStartedPulling="2026-06-02 01:55:26.361177233 +0000 UTC m=+285.713196960" lastFinishedPulling="2026-06-02 01:55:28.201664385 +0000 UTC m=+287.553684126" observedRunningTime="2026-06-02 01:55:29.281779284 +0000 UTC m=+288.633799033" watchObservedRunningTime="2026-06-02 01:55:29.28259556 +0000 UTC m=+288.634615358"
Jun 02 01:55:30.763590 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:30.763548    2567 patch_prober.go:28] interesting pod/image-registry-5b9cfbffb4-dvbl5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 02 01:55:30.763957 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:30.763603    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 01:55:39.218444 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:39.218412    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfxxl"
Jun 02 01:55:40.763431 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:40.763402    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:55:41.136644 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:41.136565    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:55:41.138273 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:41.138247    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 01:55:41.140159 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:41.140136    2567 kubelet.go:1628] "Image garbage collection succeeded"
Jun 02 01:55:45.778745 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:45.778704    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" podUID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerName="registry" containerID="cri-o://47abeee099998f06f979620a2388cfd989fcea19516058935f3f43ca2529cf4e" gracePeriod=30
Jun 02 01:55:46.759634 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:46.759581    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5968c664b9-qj7sm" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console" containerID="cri-o://ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671" gracePeriod=15
Jun 02 01:55:46.891180 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:46.891162    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 01:55:47.004765 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.004746    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5968c664b9-qj7sm_6ef3e75b-24cd-4692-ab89-275f27826ac4/console/0.log"
Jun 02 01:55:47.004874 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.004804    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:55:47.105272 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105177    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105272 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105254    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105502 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105275    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105502 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105308    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105502 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105341    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105502 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105408    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlww6\" (UniqueName: \"kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6\") pod \"6ef3e75b-24cd-4692-ab89-275f27826ac4\" (UID: \"6ef3e75b-24cd-4692-ab89-275f27826ac4\") "
Jun 02 01:55:47.105707 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105570    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:47.105707 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105666    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-oauth-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.105812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105733    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config" (OuterVolumeSpecName: "console-config") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:47.105812 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.105756    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 02 01:55:47.107530 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.107498    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:47.107651 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.107613    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 01:55:47.107651 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.107620    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6" (OuterVolumeSpecName: "kube-api-access-hlww6") pod "6ef3e75b-24cd-4692-ab89-275f27826ac4" (UID: "6ef3e75b-24cd-4692-ab89-275f27826ac4"). InnerVolumeSpecName "kube-api-access-hlww6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 01:55:47.206238 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.206185    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlww6\" (UniqueName: \"kubernetes.io/projected/6ef3e75b-24cd-4692-ab89-275f27826ac4-kube-api-access-hlww6\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.206238 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.206233    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-oauth-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.206433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.206247    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.206433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.206261    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ef3e75b-24cd-4692-ab89-275f27826ac4-console-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.206433 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.206277    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ef3e75b-24cd-4692-ab89-275f27826ac4-service-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 01:55:47.267367 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5968c664b9-qj7sm_6ef3e75b-24cd-4692-ab89-275f27826ac4/console/0.log"
Jun 02 01:55:47.267550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267378    2567 generic.go:358] "Generic (PLEG): container finished" podID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerID="ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671" exitCode=2
Jun 02 01:55:47.267550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267453    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5968c664b9-qj7sm"
Jun 02 01:55:47.267550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267465    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5968c664b9-qj7sm" event={"ID":"6ef3e75b-24cd-4692-ab89-275f27826ac4","Type":"ContainerDied","Data":"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"}
Jun 02 01:55:47.267550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267502    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5968c664b9-qj7sm" event={"ID":"6ef3e75b-24cd-4692-ab89-275f27826ac4","Type":"ContainerDied","Data":"24e9128fe35df9350c1753ee00a382846f85cb0b5e818d231526992f38edcf2e"}
Jun 02 01:55:47.267550 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.267521    2567 scope.go:117] "RemoveContainer" containerID="ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"
Jun 02 01:55:47.270400 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.270374    2567 generic.go:358] "Generic (PLEG): container finished" podID="3ee63f14-72b9-447c-bcb2-d4170d17738b" containerID="47abeee099998f06f979620a2388cfd989fcea19516058935f3f43ca2529cf4e" exitCode=0
Jun 02 01:55:47.270528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.270414    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerDied","Data":"47abeee099998f06f979620a2388cfd989fcea19516058935f3f43ca2529cf4e"}
Jun 02 01:55:47.270528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.270442    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5" event={"ID":"3ee63f14-72b9-447c-bcb2-d4170d17738b","Type":"ContainerStarted","Data":"9eeca1f8797e841ca423f58b76e5fa269f8f09c019ab36edd05fffdf2d44bc77"}
Jun 02 01:55:47.270528 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.270492    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:55:47.275303 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.275275    2567 scope.go:117] "RemoveContainer" containerID="ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"
Jun 02 01:55:47.275567 ip-10-0-138-87 kubenswrapper[2567]: E0602 01:55:47.275548    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671\": container with ID starting with ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671 not found: ID does not exist" containerID="ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"
Jun 02 01:55:47.275640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.275574    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671"} err="failed to get container status \"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671\": rpc error: code = NotFound desc = could not find container \"ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671\": container with ID starting with ec3c028e8dc26d95d5d4a35dce6a882ff72bf964c0b79f40c587a18a271d5671 not found: ID does not exist"
Jun 02 01:55:47.275640 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.275590    2567 scope.go:117] "RemoveContainer" containerID="2fcbf454e0639cb329ec0fb02b3e885f9e79a8e307155367875d7a4503f537d4"
Jun 02 01:55:47.351466 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.351432    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:55:47.369807 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:47.369739    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5968c664b9-qj7sm"]
Jun 02 01:55:49.212347 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:55:49.212312    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" path="/var/lib/kubelet/pods/6ef3e75b-24cd-4692-ab89-275f27826ac4/volumes"
Jun 02 01:56:08.280461 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:56:08.280430    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9cfbffb4-dvbl5"
Jun 02 01:56:19.542343 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:56:19.542241    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:56:19.557158 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:56:19.557137    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:56:20.381157 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:56:20.381130    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 02 01:57:12.236270 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.236232    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2fqc8"]
Jun 02 01:57:12.236740 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.236527    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console"
Jun 02 01:57:12.236740 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.236538    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console"
Jun 02 01:57:12.236740 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.236583    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ef3e75b-24cd-4692-ab89-275f27826ac4" containerName="console"
Jun 02 01:57:12.239432 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.239416    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.241323 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.241301    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 02 01:57:12.247373 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.247351    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fqc8"]
Jun 02 01:57:12.413676 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.413642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-kubelet-config\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.413676 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.413683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-dbus\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.413892 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.413703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3941037e-03f5-40db-bd45-0f16ddbd25c9-original-pull-secret\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.514541 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.514465    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-kubelet-config\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.514541 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.514504    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-dbus\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.514541 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.514531    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3941037e-03f5-40db-bd45-0f16ddbd25c9-original-pull-secret\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.514710 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.514588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-kubelet-config\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.514710 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.514668    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3941037e-03f5-40db-bd45-0f16ddbd25c9-dbus\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.516754 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.516736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3941037e-03f5-40db-bd45-0f16ddbd25c9-original-pull-secret\") pod \"global-pull-secret-syncer-2fqc8\" (UID: \"3941037e-03f5-40db-bd45-0f16ddbd25c9\") " pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.548713 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.548686    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fqc8"
Jun 02 01:57:12.669822 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:12.669790    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fqc8"]
Jun 02 01:57:12.672823 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:57:12.672798    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3941037e_03f5_40db_bd45_0f16ddbd25c9.slice/crio-0c7c15a7eb0683ff772d3ee82dab7facca23b7228772f5ebd51a9e27248d9716 WatchSource:0}: Error finding container 0c7c15a7eb0683ff772d3ee82dab7facca23b7228772f5ebd51a9e27248d9716: Status 404 returned error can't find the container with id 0c7c15a7eb0683ff772d3ee82dab7facca23b7228772f5ebd51a9e27248d9716
Jun 02 01:57:13.528526 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:13.528480    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fqc8" event={"ID":"3941037e-03f5-40db-bd45-0f16ddbd25c9","Type":"ContainerStarted","Data":"0c7c15a7eb0683ff772d3ee82dab7facca23b7228772f5ebd51a9e27248d9716"}
Jun 02 01:57:16.539714 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:16.539682    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fqc8" event={"ID":"3941037e-03f5-40db-bd45-0f16ddbd25c9","Type":"ContainerStarted","Data":"fc5fabbe8bf75478929431ea5ad41875cb52a5fec3ca20e2100cf433990e1a4a"}
Jun 02 01:57:16.553378 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:57:16.553264    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2fqc8" podStartSLOduration=0.923552835 podStartE2EDuration="4.553246395s" podCreationTimestamp="2026-06-02 01:57:12 +0000 UTC" firstStartedPulling="2026-06-02 01:57:12.674440345 +0000 UTC m=+392.026460072" lastFinishedPulling="2026-06-02 01:57:16.304133901 +0000 UTC m=+395.656153632" observedRunningTime="2026-06-02 01:57:16.553244662 +0000 UTC m=+395.905264410" watchObservedRunningTime="2026-06-02 01:57:16.553246395 +0000 UTC m=+395.905266148"
Jun 02 01:58:48.287916 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.287885    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"]
Jun 02 01:58:48.290537 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.290521    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.294414 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.294392    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 02 01:58:48.295877 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.295854    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 02 01:58:48.296185 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.296166    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 02 01:58:48.296307 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.296284    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pb8p4\""
Jun 02 01:58:48.297168 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.296920    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 02 01:58:48.307753 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.307728    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"]
Jun 02 01:58:48.406331 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.406300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.406476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.406345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.406476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.406379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.406476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.406405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.406476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.406429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzk5\" (UniqueName: \"kubernetes.io/projected/67fad6aa-b849-4f8b-96b3-d6315eb018a8-kube-api-access-dlzk5\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507151 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507113    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzk5\" (UniqueName: \"kubernetes.io/projected/67fad6aa-b849-4f8b-96b3-d6315eb018a8-kube-api-access-dlzk5\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507313 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507187    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507313 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507226    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507313 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507254    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507430 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507376    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.507647 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.507627    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.509383 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.509356    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fad6aa-b849-4f8b-96b3-d6315eb018a8-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.509504 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.509488    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.509681 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.509663    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/67fad6aa-b849-4f8b-96b3-d6315eb018a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.523033 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.523005    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzk5\" (UniqueName: \"kubernetes.io/projected/67fad6aa-b849-4f8b-96b3-d6315eb018a8-kube-api-access-dlzk5\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-f5tjt\" (UID: \"67fad6aa-b849-4f8b-96b3-d6315eb018a8\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.601062 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.600994    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:48.732744 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.732719    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"]
Jun 02 01:58:48.735767 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:58:48.735743    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fad6aa_b849_4f8b_96b3_d6315eb018a8.slice/crio-b274cb4ae29465e9928359f85d8e9bef78dd5bd6bc7d1ca8cba5415e25815ecf WatchSource:0}: Error finding container b274cb4ae29465e9928359f85d8e9bef78dd5bd6bc7d1ca8cba5415e25815ecf: Status 404 returned error can't find the container with id b274cb4ae29465e9928359f85d8e9bef78dd5bd6bc7d1ca8cba5415e25815ecf
Jun 02 01:58:48.814768 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:48.814730    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt" event={"ID":"67fad6aa-b849-4f8b-96b3-d6315eb018a8","Type":"ContainerStarted","Data":"b274cb4ae29465e9928359f85d8e9bef78dd5bd6bc7d1ca8cba5415e25815ecf"}
Jun 02 01:58:51.825169 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:51.825084    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt" event={"ID":"67fad6aa-b849-4f8b-96b3-d6315eb018a8","Type":"ContainerStarted","Data":"bd53e43ada4f1453a27bc8db4c72392495d4f564ecef88e8955534215c426f27"}
Jun 02 01:58:52.829665 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:52.829575    2567 generic.go:358] "Generic (PLEG): container finished" podID="67fad6aa-b849-4f8b-96b3-d6315eb018a8" containerID="bd53e43ada4f1453a27bc8db4c72392495d4f564ecef88e8955534215c426f27" exitCode=0
Jun 02 01:58:52.829665 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:52.829648    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt" event={"ID":"67fad6aa-b849-4f8b-96b3-d6315eb018a8","Type":"ContainerDied","Data":"bd53e43ada4f1453a27bc8db4c72392495d4f564ecef88e8955534215c426f27"}
Jun 02 01:58:53.834589 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:53.834546    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt" event={"ID":"67fad6aa-b849-4f8b-96b3-d6315eb018a8","Type":"ContainerStarted","Data":"51257676df0941871b5bd36404f43310c60b3757e69ef0f7fe8c24eb4d36bfb5"}
Jun 02 01:58:53.834983 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:53.834703    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:58:53.873362 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:58:53.873307    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt" podStartSLOduration=1.4315683319999999 podStartE2EDuration="5.87329348s" podCreationTimestamp="2026-06-02 01:58:48 +0000 UTC" firstStartedPulling="2026-06-02 01:58:48.737415616 +0000 UTC m=+488.089435343" lastFinishedPulling="2026-06-02 01:58:53.179140762 +0000 UTC m=+492.531160491" observedRunningTime="2026-06-02 01:58:53.871247703 +0000 UTC m=+493.223267452" watchObservedRunningTime="2026-06-02 01:58:53.87329348 +0000 UTC m=+493.225313228"
Jun 02 01:59:04.839390 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:04.839355    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-f5tjt"
Jun 02 01:59:07.832305 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.832268    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"]
Jun 02 01:59:07.840879 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.840845    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.846393 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.846363    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 02 01:59:07.846538 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.846401    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 02 01:59:07.846746 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.846730    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 02 01:59:07.846818 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.846801    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 02 01:59:07.859435 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.859408    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"]
Jun 02 01:59:07.871683 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.871656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9m28\" (UniqueName: \"kubernetes.io/projected/46df8ebf-7ebc-4d29-9f18-52adc97459f9-kube-api-access-b9m28\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.871824 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.871702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.871897 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.871857    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tmp\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.973066 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.973024    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tmp\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.973235 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.973104    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9m28\" (UniqueName: \"kubernetes.io/projected/46df8ebf-7ebc-4d29-9f18-52adc97459f9-kube-api-access-b9m28\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.973235 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.973142    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.975408 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.975380    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tmp\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.975759 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.975735    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46df8ebf-7ebc-4d29-9f18-52adc97459f9-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:07.999476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:07.999450    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9m28\" (UniqueName: \"kubernetes.io/projected/46df8ebf-7ebc-4d29-9f18-52adc97459f9-kube-api-access-b9m28\") pod \"kube-auth-proxy-c9f895b8b-kmd52\" (UID: \"46df8ebf-7ebc-4d29-9f18-52adc97459f9\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:08.151060 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.151023    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"
Jun 02 01:59:08.314959 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.314921    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52"]
Jun 02 01:59:08.321924 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:59:08.321899    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46df8ebf_7ebc_4d29_9f18_52adc97459f9.slice/crio-6ede0290c9bacc639fbd07c2745557dd2271b8d2af4ec1cf7c3cf970fa9bb4a6 WatchSource:0}: Error finding container 6ede0290c9bacc639fbd07c2745557dd2271b8d2af4ec1cf7c3cf970fa9bb4a6: Status 404 returned error can't find the container with id 6ede0290c9bacc639fbd07c2745557dd2271b8d2af4ec1cf7c3cf970fa9bb4a6
Jun 02 01:59:08.853680 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.853645    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"]
Jun 02 01:59:08.858602 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.858579    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.861193 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.861171    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 02 01:59:08.861842 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.861814    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zz9cz\""
Jun 02 01:59:08.865055 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.865025    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 02 01:59:08.865156 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.865063    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 02 01:59:08.865156 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.865093    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 02 01:59:08.865156 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.865025    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 02 01:59:08.880312 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.880290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bc36480-fd3d-48e9-81e4-a7634aacb94c-manager-config\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.880418 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.880357    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52" event={"ID":"46df8ebf-7ebc-4d29-9f18-52adc97459f9","Type":"ContainerStarted","Data":"6ede0290c9bacc639fbd07c2745557dd2271b8d2af4ec1cf7c3cf970fa9bb4a6"}
Jun 02 01:59:08.880418 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.880383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.880418 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.880408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6f48\" (UniqueName: \"kubernetes.io/projected/1bc36480-fd3d-48e9-81e4-a7634aacb94c-kube-api-access-j6f48\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.880600 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.880442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-metrics-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.891044 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.891018    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"]
Jun 02 01:59:08.980978 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.980940    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-metrics-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.981195 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.981037    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bc36480-fd3d-48e9-81e4-a7634aacb94c-manager-config\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.981195 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.981112    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.981195 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.981137    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6f48\" (UniqueName: \"kubernetes.io/projected/1bc36480-fd3d-48e9-81e4-a7634aacb94c-kube-api-access-j6f48\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.982860 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.982544    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bc36480-fd3d-48e9-81e4-a7634aacb94c-manager-config\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.985583 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.985541    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.986476 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.986403    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bc36480-fd3d-48e9-81e4-a7634aacb94c-metrics-cert\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:08.999580 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:08.999556    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6f48\" (UniqueName: \"kubernetes.io/projected/1bc36480-fd3d-48e9-81e4-a7634aacb94c-kube-api-access-j6f48\") pod \"lws-controller-manager-f66fcb844-v8hzg\" (UID: \"1bc36480-fd3d-48e9-81e4-a7634aacb94c\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:09.170845 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:09.170797    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:09.346787 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:09.346749    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"]
Jun 02 01:59:09.352407 ip-10-0-138-87 kubenswrapper[2567]: W0602 01:59:09.352374    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc36480_fd3d_48e9_81e4_a7634aacb94c.slice/crio-8a271ae7abb52699f3143a2a3ee87f03761ca5dce8bbae02785f3a1d233f3476 WatchSource:0}: Error finding container 8a271ae7abb52699f3143a2a3ee87f03761ca5dce8bbae02785f3a1d233f3476: Status 404 returned error can't find the container with id 8a271ae7abb52699f3143a2a3ee87f03761ca5dce8bbae02785f3a1d233f3476
Jun 02 01:59:09.886674 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:09.886634    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg" event={"ID":"1bc36480-fd3d-48e9-81e4-a7634aacb94c","Type":"ContainerStarted","Data":"8a271ae7abb52699f3143a2a3ee87f03761ca5dce8bbae02785f3a1d233f3476"}
Jun 02 01:59:11.895576 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:11.895539    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52" event={"ID":"46df8ebf-7ebc-4d29-9f18-52adc97459f9","Type":"ContainerStarted","Data":"b708483d3a5d887fb686ac95162927c45536aa7badee8efc52f21794f648f9bb"}
Jun 02 01:59:11.911898 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:11.911848    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-kmd52" podStartSLOduration=2.111771374 podStartE2EDuration="4.91183339s" podCreationTimestamp="2026-06-02 01:59:07 +0000 UTC" firstStartedPulling="2026-06-02 01:59:08.323413195 +0000 UTC m=+507.675432922" lastFinishedPulling="2026-06-02 01:59:11.123475194 +0000 UTC m=+510.475494938" observedRunningTime="2026-06-02 01:59:11.910660329 +0000 UTC m=+511.262680078" watchObservedRunningTime="2026-06-02 01:59:11.91183339 +0000 UTC m=+511.263853160"
Jun 02 01:59:13.904319 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:13.904283    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg" event={"ID":"1bc36480-fd3d-48e9-81e4-a7634aacb94c","Type":"ContainerStarted","Data":"3ff08d25fbb3960d519f9816a3957153d303a49bd3191375face4078e93eb9c4"}
Jun 02 01:59:13.904811 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:13.904342    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 01:59:13.929241 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:13.929178    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg" podStartSLOduration=2.285502052 podStartE2EDuration="5.92916461s" podCreationTimestamp="2026-06-02 01:59:08 +0000 UTC" firstStartedPulling="2026-06-02 01:59:09.35529185 +0000 UTC m=+508.707311590" lastFinishedPulling="2026-06-02 01:59:12.99895442 +0000 UTC m=+512.350974148" observedRunningTime="2026-06-02 01:59:13.928965589 +0000 UTC m=+513.280985341" watchObservedRunningTime="2026-06-02 01:59:13.92916461 +0000 UTC m=+513.281184359"
Jun 02 01:59:24.911231 ip-10-0-138-87 kubenswrapper[2567]: I0602 01:59:24.911193    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-v8hzg"
Jun 02 02:00:41.161744 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:41.161715    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:00:41.162290 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:41.162073    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:00:53.206244 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.206188    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wspzr"]
Jun 02 02:00:53.209543 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.209519    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:53.211912 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.211889    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 02 02:00:53.212500 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.212479    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 02 02:00:53.212500 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.212493    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jkllh\""
Jun 02 02:00:53.226438 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.226415    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wspzr"]
Jun 02 02:00:53.291532 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.291492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88kx\" (UniqueName: \"kubernetes.io/projected/e0d5609f-df08-4d16-9939-c57316e9a3be-kube-api-access-h88kx\") pod \"authorino-operator-657f44b778-wspzr\" (UID: \"e0d5609f-df08-4d16-9939-c57316e9a3be\") " pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:53.392300 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.392265    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h88kx\" (UniqueName: \"kubernetes.io/projected/e0d5609f-df08-4d16-9939-c57316e9a3be-kube-api-access-h88kx\") pod \"authorino-operator-657f44b778-wspzr\" (UID: \"e0d5609f-df08-4d16-9939-c57316e9a3be\") " pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:53.401606 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.401567    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h88kx\" (UniqueName: \"kubernetes.io/projected/e0d5609f-df08-4d16-9939-c57316e9a3be-kube-api-access-h88kx\") pod \"authorino-operator-657f44b778-wspzr\" (UID: \"e0d5609f-df08-4d16-9939-c57316e9a3be\") " pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:53.520361 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.520280    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:53.651876 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.651855    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wspzr"]
Jun 02 02:00:53.654553 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:00:53.654522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d5609f_df08_4d16_9939_c57316e9a3be.slice/crio-56712bc17974704c49f367546c91435fec8dfa1ba51be78428935e22b480486b WatchSource:0}: Error finding container 56712bc17974704c49f367546c91435fec8dfa1ba51be78428935e22b480486b: Status 404 returned error can't find the container with id 56712bc17974704c49f367546c91435fec8dfa1ba51be78428935e22b480486b
Jun 02 02:00:53.656375 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:53.656359    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 02:00:54.240755 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:54.240718    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wspzr" event={"ID":"e0d5609f-df08-4d16-9939-c57316e9a3be","Type":"ContainerStarted","Data":"56712bc17974704c49f367546c91435fec8dfa1ba51be78428935e22b480486b"}
Jun 02 02:00:56.251844 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:56.251803    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wspzr" event={"ID":"e0d5609f-df08-4d16-9939-c57316e9a3be","Type":"ContainerStarted","Data":"da363d6fd1556e172b0d71c4f48cbe748f0eb891c1a8dc62b22e09bcf3c33bd1"}
Jun 02 02:00:56.252242 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:56.251915    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:00:56.281157 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:56.281110    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-wspzr" podStartSLOduration=1.125945553 podStartE2EDuration="3.28109357s" podCreationTimestamp="2026-06-02 02:00:53 +0000 UTC" firstStartedPulling="2026-06-02 02:00:53.656484114 +0000 UTC m=+613.008503841" lastFinishedPulling="2026-06-02 02:00:55.811632121 +0000 UTC m=+615.163651858" observedRunningTime="2026-06-02 02:00:56.279626596 +0000 UTC m=+615.631646347" watchObservedRunningTime="2026-06-02 02:00:56.28109357 +0000 UTC m=+615.633113320"
Jun 02 02:00:58.156921 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.156882    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"]
Jun 02 02:00:58.161155 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.161114    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.164022 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.163997    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 02 02:00:58.164165 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.164074    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 02 02:00:58.164165 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.164074    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvzkm\""
Jun 02 02:00:58.169248 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.169203    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"]
Jun 02 02:00:58.232757 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.232724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cm4x\" (UniqueName: \"kubernetes.io/projected/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-kube-api-access-6cm4x\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.232925 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.232762    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.232925 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.232791    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.333427 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.333390    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cm4x\" (UniqueName: \"kubernetes.io/projected/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-kube-api-access-6cm4x\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.333585 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.333432    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.333585 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.333472    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.333661 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:00:58.333616    2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jun 02 02:00:58.333698 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:00:58.333692    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert podName:5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374 nodeName:}" failed. No retries permitted until 2026-06-02 02:00:58.833671785 +0000 UTC m=+618.185691526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-lwl2w" (UID: "5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374") : secret "plugin-serving-cert" not found
Jun 02 02:00:58.334041 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.334021    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.343623 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.343597    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cm4x\" (UniqueName: \"kubernetes.io/projected/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-kube-api-access-6cm4x\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.838180 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.838136    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:58.840580 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:58.840550    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-lwl2w\" (UID: \"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:59.089206 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:59.089117    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"
Jun 02 02:00:59.217938 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:59.217896    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w"]
Jun 02 02:00:59.221246 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:00:59.221186    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc4e5ce_0bf8_4fd5_8b9a_2d2cb270c374.slice/crio-7b2a93cef9bb463308ca426d264654563f6862ca0b53daacb2a08582ea538e3d WatchSource:0}: Error finding container 7b2a93cef9bb463308ca426d264654563f6862ca0b53daacb2a08582ea538e3d: Status 404 returned error can't find the container with id 7b2a93cef9bb463308ca426d264654563f6862ca0b53daacb2a08582ea538e3d
Jun 02 02:00:59.262559 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:00:59.262528    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w" event={"ID":"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374","Type":"ContainerStarted","Data":"7b2a93cef9bb463308ca426d264654563f6862ca0b53daacb2a08582ea538e3d"}
Jun 02 02:01:07.257459 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:07.257376    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-wspzr"
Jun 02 02:01:24.353288 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:24.353193    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w" event={"ID":"5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374","Type":"ContainerStarted","Data":"367253dbe789badd6a7841b7481c9534040d1d714f91c73f0bd627f416cbfcea"}
Jun 02 02:01:24.373135 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:24.373091    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-lwl2w" podStartSLOduration=1.599932764 podStartE2EDuration="26.373078638s" podCreationTimestamp="2026-06-02 02:00:58 +0000 UTC" firstStartedPulling="2026-06-02 02:00:59.222951438 +0000 UTC m=+618.574971165" lastFinishedPulling="2026-06-02 02:01:23.996097309 +0000 UTC m=+643.348117039" observedRunningTime="2026-06-02 02:01:24.370974834 +0000 UTC m=+643.722994583" watchObservedRunningTime="2026-06-02 02:01:24.373078638 +0000 UTC m=+643.725098393"
Jun 02 02:01:45.573865 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.573815    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:45.610710 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.610681    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:45.610874 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.610787    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:45.613035 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.613010    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ztnj\""
Jun 02 02:01:45.680861 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.680829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnmz\" (UniqueName: \"kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz\") pod \"authorino-f99f4b5cd-7pcng\" (UID: \"30951387-cc19-43a3-93e4-34efdfeafb98\") " pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:45.724312 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.724278    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:01:45.766931 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.766900    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:01:45.767076 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.767014    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:01:45.781761 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.781737    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnmz\" (UniqueName: \"kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz\") pod \"authorino-f99f4b5cd-7pcng\" (UID: \"30951387-cc19-43a3-93e4-34efdfeafb98\") " pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:45.790119 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.790099    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnmz\" (UniqueName: \"kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz\") pod \"authorino-f99f4b5cd-7pcng\" (UID: \"30951387-cc19-43a3-93e4-34efdfeafb98\") " pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:45.882931 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.882844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48zfb\" (UniqueName: \"kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb\") pod \"authorino-7498df8756-dng98\" (UID: \"b863df89-09b0-4db7-9715-4657d4659f43\") " pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:01:45.919771 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.919739    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:45.983771 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.983695    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48zfb\" (UniqueName: \"kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb\") pod \"authorino-7498df8756-dng98\" (UID: \"b863df89-09b0-4db7-9715-4657d4659f43\") " pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:01:45.992735 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:45.992684    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48zfb\" (UniqueName: \"kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb\") pod \"authorino-7498df8756-dng98\" (UID: \"b863df89-09b0-4db7-9715-4657d4659f43\") " pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:01:46.047683 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:46.047659    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:46.050091 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:01:46.050066    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30951387_cc19_43a3_93e4_34efdfeafb98.slice/crio-36aad4b91534ccac2294b2b664d10c7296619d33fe48829eca61323e8e851282 WatchSource:0}: Error finding container 36aad4b91534ccac2294b2b664d10c7296619d33fe48829eca61323e8e851282: Status 404 returned error can't find the container with id 36aad4b91534ccac2294b2b664d10c7296619d33fe48829eca61323e8e851282
Jun 02 02:01:46.075941 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:46.075916    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:01:46.210181 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:46.206651    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:01:46.424450 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:46.424361    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dng98" event={"ID":"b863df89-09b0-4db7-9715-4657d4659f43","Type":"ContainerStarted","Data":"c169fab25b1a508e272cb35973e9472773577b4d0720af83957351d9654209c1"}
Jun 02 02:01:46.425377 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:46.425342    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" event={"ID":"30951387-cc19-43a3-93e4-34efdfeafb98","Type":"ContainerStarted","Data":"36aad4b91534ccac2294b2b664d10c7296619d33fe48829eca61323e8e851282"}
Jun 02 02:01:50.443316 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:50.443272    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" event={"ID":"30951387-cc19-43a3-93e4-34efdfeafb98","Type":"ContainerStarted","Data":"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"}
Jun 02 02:01:50.444828 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:50.444787    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dng98" event={"ID":"b863df89-09b0-4db7-9715-4657d4659f43","Type":"ContainerStarted","Data":"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"}
Jun 02 02:01:50.459187 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:50.459141    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" podStartSLOduration=1.260445674 podStartE2EDuration="5.459126119s" podCreationTimestamp="2026-06-02 02:01:45 +0000 UTC" firstStartedPulling="2026-06-02 02:01:46.051457831 +0000 UTC m=+665.403477561" lastFinishedPulling="2026-06-02 02:01:50.25013828 +0000 UTC m=+669.602158006" observedRunningTime="2026-06-02 02:01:50.456918233 +0000 UTC m=+669.808937981" watchObservedRunningTime="2026-06-02 02:01:50.459126119 +0000 UTC m=+669.811145867"
Jun 02 02:01:50.471100 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:50.471046    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-dng98" podStartSLOduration=1.415262368 podStartE2EDuration="5.471030521s" podCreationTimestamp="2026-06-02 02:01:45 +0000 UTC" firstStartedPulling="2026-06-02 02:01:46.208692961 +0000 UTC m=+665.560712690" lastFinishedPulling="2026-06-02 02:01:50.264461112 +0000 UTC m=+669.616480843" observedRunningTime="2026-06-02 02:01:50.470531989 +0000 UTC m=+669.822551740" watchObservedRunningTime="2026-06-02 02:01:50.471030521 +0000 UTC m=+669.823050271"
Jun 02 02:01:50.502628 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:50.502559    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:52.452528 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:52.452480    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" podUID="30951387-cc19-43a3-93e4-34efdfeafb98" containerName="authorino" containerID="cri-o://923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f" gracePeriod=30
Jun 02 02:01:52.697064 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:52.697040    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:52.848544 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:52.848466    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwnmz\" (UniqueName: \"kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz\") pod \"30951387-cc19-43a3-93e4-34efdfeafb98\" (UID: \"30951387-cc19-43a3-93e4-34efdfeafb98\") "
Jun 02 02:01:52.850638 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:52.850609    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz" (OuterVolumeSpecName: "kube-api-access-qwnmz") pod "30951387-cc19-43a3-93e4-34efdfeafb98" (UID: "30951387-cc19-43a3-93e4-34efdfeafb98"). InnerVolumeSpecName "kube-api-access-qwnmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:01:52.949971 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:52.949937    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwnmz\" (UniqueName: \"kubernetes.io/projected/30951387-cc19-43a3-93e4-34efdfeafb98-kube-api-access-qwnmz\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:01:53.456797 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.456759    2567 generic.go:358] "Generic (PLEG): container finished" podID="30951387-cc19-43a3-93e4-34efdfeafb98" containerID="923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f" exitCode=0
Jun 02 02:01:53.457235 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.456811    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7pcng"
Jun 02 02:01:53.457235 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.456821    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" event={"ID":"30951387-cc19-43a3-93e4-34efdfeafb98","Type":"ContainerDied","Data":"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"}
Jun 02 02:01:53.457235 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.456862    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7pcng" event={"ID":"30951387-cc19-43a3-93e4-34efdfeafb98","Type":"ContainerDied","Data":"36aad4b91534ccac2294b2b664d10c7296619d33fe48829eca61323e8e851282"}
Jun 02 02:01:53.457235 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.456877    2567 scope.go:117] "RemoveContainer" containerID="923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"
Jun 02 02:01:53.464934 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.464909    2567 scope.go:117] "RemoveContainer" containerID="923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"
Jun 02 02:01:53.465190 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:01:53.465172    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f\": container with ID starting with 923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f not found: ID does not exist" containerID="923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"
Jun 02 02:01:53.465261 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.465200    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f"} err="failed to get container status \"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f\": rpc error: code = NotFound desc = could not find container \"923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f\": container with ID starting with 923df56043c4ec615d80c964c55bf62f12ab5871bc26f23e25583c99ee45808f not found: ID does not exist"
Jun 02 02:01:53.477256 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.477199    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:53.489278 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:53.489260    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7pcng"]
Jun 02 02:01:55.212659 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:01:55.212625    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30951387-cc19-43a3-93e4-34efdfeafb98" path="/var/lib/kubelet/pods/30951387-cc19-43a3-93e4-34efdfeafb98/volumes"
Jun 02 02:02:39.923340 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.923302    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:02:39.923878 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.923779    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30951387-cc19-43a3-93e4-34efdfeafb98" containerName="authorino"
Jun 02 02:02:39.923878 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.923799    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="30951387-cc19-43a3-93e4-34efdfeafb98" containerName="authorino"
Jun 02 02:02:39.923994 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.923912    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="30951387-cc19-43a3-93e4-34efdfeafb98" containerName="authorino"
Jun 02 02:02:39.926925 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.926905    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:39.929062 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.929032    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 02 02:02:39.929208 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.929181    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2c8x2\""
Jun 02 02:02:39.929350 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.929262    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 02 02:02:39.929879 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.929864    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 02 02:02:39.936044 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:39.936024    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:02:40.023525 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.023487    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2njl\" (UniqueName: \"kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl\") pod \"maas-keycloak-0\" (UID: \"21102359-609a-46dd-a6ac-153023ae5313\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:40.124585 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.124548    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2njl\" (UniqueName: \"kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl\") pod \"maas-keycloak-0\" (UID: \"21102359-609a-46dd-a6ac-153023ae5313\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:40.133004 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.132973    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2njl\" (UniqueName: \"kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl\") pod \"maas-keycloak-0\" (UID: \"21102359-609a-46dd-a6ac-153023ae5313\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:40.236935 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.236848    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:40.370805 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.370727    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:02:40.372971 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:02:40.372942    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21102359_609a_46dd_a6ac_153023ae5313.slice/crio-e53d9fc2a0e9aba62524147e862738111340efeeab98094ea5f699d5d2673b5b WatchSource:0}: Error finding container e53d9fc2a0e9aba62524147e862738111340efeeab98094ea5f699d5d2673b5b: Status 404 returned error can't find the container with id e53d9fc2a0e9aba62524147e862738111340efeeab98094ea5f699d5d2673b5b
Jun 02 02:02:40.611624 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:40.611540    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21102359-609a-46dd-a6ac-153023ae5313","Type":"ContainerStarted","Data":"e53d9fc2a0e9aba62524147e862738111340efeeab98094ea5f699d5d2673b5b"}
Jun 02 02:02:44.779507 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:44.779484    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 02 02:02:45.635543 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:45.635510    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21102359-609a-46dd-a6ac-153023ae5313","Type":"ContainerStarted","Data":"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"}
Jun 02 02:02:45.655747 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:45.655680    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.252768532 podStartE2EDuration="6.65566273s" podCreationTimestamp="2026-06-02 02:02:39 +0000 UTC" firstStartedPulling="2026-06-02 02:02:40.374242597 +0000 UTC m=+719.726262324" lastFinishedPulling="2026-06-02 02:02:44.777136795 +0000 UTC m=+724.129156522" observedRunningTime="2026-06-02 02:02:45.652561169 +0000 UTC m=+725.004580919" watchObservedRunningTime="2026-06-02 02:02:45.65566273 +0000 UTC m=+725.007682481"
Jun 02 02:02:46.238045 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:46.237994    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:46.239720 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:46.239680    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:47.237806 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:47.237760    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:48.238265 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:48.238190    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:49.237428 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:49.237370    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:50.237680 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:50.237624    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:50.238180 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:50.238130    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:51.237538 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:51.237482    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:52.238300 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:52.238248    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:53.238277 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:53.238204    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:54.238166 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:54.238117    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:55.237464 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:55.237418    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:56.237589 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:56.237544    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:57.237488 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:57.237442    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused"
Jun 02 02:02:58.352347 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:58.352292    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:02:58.369093 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:02:58.369058    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 02:03:08.358780 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:08.358743    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:03:09.236526 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.236494    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:09.239164 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.239140    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:09.246751 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.246728    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:09.297650 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.297616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2gp\" (UniqueName: \"kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp\") pod \"authorino-8b475cf9f-222bg\" (UID: \"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf\") " pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:09.398526 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.398487    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2gp\" (UniqueName: \"kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp\") pod \"authorino-8b475cf9f-222bg\" (UID: \"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf\") " pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:09.406242 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.406195    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2gp\" (UniqueName: \"kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp\") pod \"authorino-8b475cf9f-222bg\" (UID: \"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf\") " pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:09.464629 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.464598    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:09.464859 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.464846    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:09.495732 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.495656    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c7466f5f4-bnxjt"]
Jun 02 02:03:09.498856 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.498835    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.503879 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.503857    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c7466f5f4-bnxjt"]
Jun 02 02:03:09.552185 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.552125    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7466f5f4-bnxjt"]
Jun 02 02:03:09.552523 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:09.552493    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k57xd], unattached volumes=[], failed to process volumes=[kube-api-access-k57xd]: context canceled" pod="kuadrant-system/authorino-6c7466f5f4-bnxjt" podUID="0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a"
Jun 02 02:03:09.581132 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.581105    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:03:09.583466 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.583436    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.585640 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.585618    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 02 02:03:09.590958 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.590937    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:03:09.599473 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.599448    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbsxc\" (UniqueName: \"kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.599570 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.599488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k57xd\" (UniqueName: \"kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd\") pod \"authorino-6c7466f5f4-bnxjt\" (UID: \"0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a\") " pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.599570 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.599516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.605665 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.605636    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:09.608792 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:03:09.608766    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1a9a0f9_d7d6_4845_abf2_ec36e10afdcf.slice/crio-5925aa7e277ffc233edd08d5f6a0002419dbb0941726eda7b575f8731b993e80 WatchSource:0}: Error finding container 5925aa7e277ffc233edd08d5f6a0002419dbb0941726eda7b575f8731b993e80: Status 404 returned error can't find the container with id 5925aa7e277ffc233edd08d5f6a0002419dbb0941726eda7b575f8731b993e80
Jun 02 02:03:09.700108 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.700079    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k57xd\" (UniqueName: \"kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd\") pod \"authorino-6c7466f5f4-bnxjt\" (UID: \"0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a\") " pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.700290 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.700120    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.700290 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.700181    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbsxc\" (UniqueName: \"kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.702538 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.702519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.707591 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.707568    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k57xd\" (UniqueName: \"kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd\") pod \"authorino-6c7466f5f4-bnxjt\" (UID: \"0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a\") " pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.707729 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.707708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbsxc\" (UniqueName: \"kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc\") pod \"authorino-86b6d74d6b-gkclp\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") " pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.729341 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.729309    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-222bg" event={"ID":"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf","Type":"ContainerStarted","Data":"5925aa7e277ffc233edd08d5f6a0002419dbb0941726eda7b575f8731b993e80"}
Jun 02 02:03:09.729471 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.729317    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.734102 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.734080    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:09.801242 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.801135    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k57xd\" (UniqueName: \"kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd\") pod \"0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a\" (UID: \"0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a\") "
Jun 02 02:03:09.803278 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.803245    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd" (OuterVolumeSpecName: "kube-api-access-k57xd") pod "0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a" (UID: "0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a"). InnerVolumeSpecName "kube-api-access-k57xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:03:09.894614 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.894581    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:03:09.902609 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:09.902584    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k57xd\" (UniqueName: \"kubernetes.io/projected/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a-kube-api-access-k57xd\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:03:10.022571 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.022414    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:03:10.024774 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:03:10.024745    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c954f68_2c26_4be1_b36b_8010b587563b.slice/crio-fcd488e7bd736c6c080dbbc74490b68ca70c0aeb23f034d81e6dcc8753738914 WatchSource:0}: Error finding container fcd488e7bd736c6c080dbbc74490b68ca70c0aeb23f034d81e6dcc8753738914: Status 404 returned error can't find the container with id fcd488e7bd736c6c080dbbc74490b68ca70c0aeb23f034d81e6dcc8753738914
Jun 02 02:03:10.734805 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.734768    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-222bg" event={"ID":"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf","Type":"ContainerStarted","Data":"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"}
Jun 02 02:03:10.735326 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.734821    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-222bg" podUID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" containerName="authorino" containerID="cri-o://b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f" gracePeriod=30
Jun 02 02:03:10.736252 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.736205    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" event={"ID":"8c954f68-2c26-4be1-b36b-8010b587563b","Type":"ContainerStarted","Data":"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"}
Jun 02 02:03:10.736547 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.736270    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" event={"ID":"8c954f68-2c26-4be1-b36b-8010b587563b","Type":"ContainerStarted","Data":"fcd488e7bd736c6c080dbbc74490b68ca70c0aeb23f034d81e6dcc8753738914"}
Jun 02 02:03:10.736547 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.736233    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7466f5f4-bnxjt"
Jun 02 02:03:10.752633 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.752589    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-222bg" podStartSLOduration=1.411056728 podStartE2EDuration="1.752575948s" podCreationTimestamp="2026-06-02 02:03:09 +0000 UTC" firstStartedPulling="2026-06-02 02:03:09.609995701 +0000 UTC m=+748.962015427" lastFinishedPulling="2026-06-02 02:03:09.951514917 +0000 UTC m=+749.303534647" observedRunningTime="2026-06-02 02:03:10.750506481 +0000 UTC m=+750.102526240" watchObservedRunningTime="2026-06-02 02:03:10.752575948 +0000 UTC m=+750.104595698"
Jun 02 02:03:10.767735 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.767692    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" podStartSLOduration=1.494165063 podStartE2EDuration="1.767681367s" podCreationTimestamp="2026-06-02 02:03:09 +0000 UTC" firstStartedPulling="2026-06-02 02:03:10.026150647 +0000 UTC m=+749.378170386" lastFinishedPulling="2026-06-02 02:03:10.299666946 +0000 UTC m=+749.651686690" observedRunningTime="2026-06-02 02:03:10.766460504 +0000 UTC m=+750.118480261" watchObservedRunningTime="2026-06-02 02:03:10.767681367 +0000 UTC m=+750.119701173"
Jun 02 02:03:10.795515 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.795486    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:03:10.795770 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.795743    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-dng98" podUID="b863df89-09b0-4db7-9715-4657d4659f43" containerName="authorino" containerID="cri-o://d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d" gracePeriod=30
Jun 02 02:03:10.815949 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.815920    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7466f5f4-bnxjt"]
Jun 02 02:03:10.821579 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:10.821555    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c7466f5f4-bnxjt"]
Jun 02 02:03:11.049158 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.049136    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:11.067950 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.067922    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:03:11.113051 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.113023    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48zfb\" (UniqueName: \"kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb\") pod \"b863df89-09b0-4db7-9715-4657d4659f43\" (UID: \"b863df89-09b0-4db7-9715-4657d4659f43\") "
Jun 02 02:03:11.113197 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.113103    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g2gp\" (UniqueName: \"kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp\") pod \"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf\" (UID: \"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf\") "
Jun 02 02:03:11.115116 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.115091    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp" (OuterVolumeSpecName: "kube-api-access-4g2gp") pod "e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" (UID: "e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf"). InnerVolumeSpecName "kube-api-access-4g2gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:03:11.115251 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.115120    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb" (OuterVolumeSpecName: "kube-api-access-48zfb") pod "b863df89-09b0-4db7-9715-4657d4659f43" (UID: "b863df89-09b0-4db7-9715-4657d4659f43"). InnerVolumeSpecName "kube-api-access-48zfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:03:11.212679 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.212645    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a" path="/var/lib/kubelet/pods/0a12bf55-32e0-4ede-9e91-9ca1e7a84a5a/volumes"
Jun 02 02:03:11.214326 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.214303    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g2gp\" (UniqueName: \"kubernetes.io/projected/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf-kube-api-access-4g2gp\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:03:11.214326 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.214327    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48zfb\" (UniqueName: \"kubernetes.io/projected/b863df89-09b0-4db7-9715-4657d4659f43-kube-api-access-48zfb\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:03:11.741126 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.741035    2567 generic.go:358] "Generic (PLEG): container finished" podID="b863df89-09b0-4db7-9715-4657d4659f43" containerID="d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d" exitCode=0
Jun 02 02:03:11.741126 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.741079    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-dng98"
Jun 02 02:03:11.741646 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.741074    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dng98" event={"ID":"b863df89-09b0-4db7-9715-4657d4659f43","Type":"ContainerDied","Data":"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"}
Jun 02 02:03:11.741646 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.741189    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-dng98" event={"ID":"b863df89-09b0-4db7-9715-4657d4659f43","Type":"ContainerDied","Data":"c169fab25b1a508e272cb35973e9472773577b4d0720af83957351d9654209c1"}
Jun 02 02:03:11.741646 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.741234    2567 scope.go:117] "RemoveContainer" containerID="d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"
Jun 02 02:03:11.742517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.742315    2567 generic.go:358] "Generic (PLEG): container finished" podID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" containerID="b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f" exitCode=0
Jun 02 02:03:11.742517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.742363    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-222bg"
Jun 02 02:03:11.742517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.742391    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-222bg" event={"ID":"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf","Type":"ContainerDied","Data":"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"}
Jun 02 02:03:11.742517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.742427    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-222bg" event={"ID":"e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf","Type":"ContainerDied","Data":"5925aa7e277ffc233edd08d5f6a0002419dbb0941726eda7b575f8731b993e80"}
Jun 02 02:03:11.750193 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.750179    2567 scope.go:117] "RemoveContainer" containerID="d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"
Jun 02 02:03:11.750473 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:11.750453    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d\": container with ID starting with d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d not found: ID does not exist" containerID="d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"
Jun 02 02:03:11.750548 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.750479    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d"} err="failed to get container status \"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d\": rpc error: code = NotFound desc = could not find container \"d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d\": container with ID starting with d416da8c7422a5db563ab79b012c10c67fa7929ae6366a8454b2b8e91e5aa69d not found: ID does not exist"
Jun 02 02:03:11.750548 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.750496    2567 scope.go:117] "RemoveContainer" containerID="b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"
Jun 02 02:03:11.757878 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.757753    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:11.757943 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.757895    2567 scope.go:117] "RemoveContainer" containerID="b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"
Jun 02 02:03:11.758149 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:11.758129    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f\": container with ID starting with b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f not found: ID does not exist" containerID="b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"
Jun 02 02:03:11.758207 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.758154    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f"} err="failed to get container status \"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f\": rpc error: code = NotFound desc = could not find container \"b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f\": container with ID starting with b00a7fe125439a318fdf2587ffe51cfd424758d6c14ae1bb0217154cf5f3157f not found: ID does not exist"
Jun 02 02:03:11.764257 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.764238    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-222bg"]
Jun 02 02:03:11.774633 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.774611    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:03:11.779063 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:11.779043    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-dng98"]
Jun 02 02:03:13.214034 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:13.214001    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b863df89-09b0-4db7-9715-4657d4659f43" path="/var/lib/kubelet/pods/b863df89-09b0-4db7-9715-4657d4659f43/volumes"
Jun 02 02:03:13.214423 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:13.214331    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" path="/var/lib/kubelet/pods/e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf/volumes"
Jun 02 02:03:14.173656 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.173621    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:14.174010 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.173996    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b863df89-09b0-4db7-9715-4657d4659f43" containerName="authorino"
Jun 02 02:03:14.174065 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.174012    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b863df89-09b0-4db7-9715-4657d4659f43" containerName="authorino"
Jun 02 02:03:14.174065 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.174030    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" containerName="authorino"
Jun 02 02:03:14.174065 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.174035    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" containerName="authorino"
Jun 02 02:03:14.174159 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.174088    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1a9a0f9-d7d6-4845-abf2-ec36e10afdcf" containerName="authorino"
Jun 02 02:03:14.174159 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.174097    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b863df89-09b0-4db7-9715-4657d4659f43" containerName="authorino"
Jun 02 02:03:14.176682 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.176666    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:14.179297 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.179274    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bxscn\""
Jun 02 02:03:14.179569 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.179553    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 02 02:03:14.188496 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.188477    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:14.241677 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.241644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpc6\" (UniqueName: \"kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6\") pod \"maas-controller-6965974ccc-sr7tf\" (UID: \"5cfc24f1-be50-4483-9e21-ebfadcc8db03\") " pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:14.342988 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.342936    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpc6\" (UniqueName: \"kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6\") pod \"maas-controller-6965974ccc-sr7tf\" (UID: \"5cfc24f1-be50-4483-9e21-ebfadcc8db03\") " pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:14.348241 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.348200    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-88975744-bkzsc"]
Jun 02 02:03:14.350446 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.350429    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:14.353588 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.353562    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpc6\" (UniqueName: \"kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6\") pod \"maas-controller-6965974ccc-sr7tf\" (UID: \"5cfc24f1-be50-4483-9e21-ebfadcc8db03\") " pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:14.363021 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.362996    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-88975744-bkzsc"]
Jun 02 02:03:14.443661 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.443588    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr62t\" (UniqueName: \"kubernetes.io/projected/322bb65d-e623-4bae-9ea6-9c49ca3d4d6a-kube-api-access-xr62t\") pod \"maas-controller-88975744-bkzsc\" (UID: \"322bb65d-e623-4bae-9ea6-9c49ca3d4d6a\") " pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:14.487502 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.487472    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:14.544204 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.544155    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr62t\" (UniqueName: \"kubernetes.io/projected/322bb65d-e623-4bae-9ea6-9c49ca3d4d6a-kube-api-access-xr62t\") pod \"maas-controller-88975744-bkzsc\" (UID: \"322bb65d-e623-4bae-9ea6-9c49ca3d4d6a\") " pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:14.553705 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.553639    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr62t\" (UniqueName: \"kubernetes.io/projected/322bb65d-e623-4bae-9ea6-9c49ca3d4d6a-kube-api-access-xr62t\") pod \"maas-controller-88975744-bkzsc\" (UID: \"322bb65d-e623-4bae-9ea6-9c49ca3d4d6a\") " pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:14.614742 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.614717    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:14.616412 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:03:14.616381    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfc24f1_be50_4483_9e21_ebfadcc8db03.slice/crio-5016c27738ad7cb5686e46ed4c36d2aef20f038591d39ffe7b9aaf10f6b5c6b4 WatchSource:0}: Error finding container 5016c27738ad7cb5686e46ed4c36d2aef20f038591d39ffe7b9aaf10f6b5c6b4: Status 404 returned error can't find the container with id 5016c27738ad7cb5686e46ed4c36d2aef20f038591d39ffe7b9aaf10f6b5c6b4
Jun 02 02:03:14.669401 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.669377    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:14.756840 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.756806    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6965974ccc-sr7tf" event={"ID":"5cfc24f1-be50-4483-9e21-ebfadcc8db03","Type":"ContainerStarted","Data":"5016c27738ad7cb5686e46ed4c36d2aef20f038591d39ffe7b9aaf10f6b5c6b4"}
Jun 02 02:03:14.797506 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:14.797477    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-88975744-bkzsc"]
Jun 02 02:03:14.799900 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:03:14.799876    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322bb65d_e623_4bae_9ea6_9c49ca3d4d6a.slice/crio-fc4f8b417bffb06d8f290478b2ab45fee420ec8c4f0c6a04ecc169725bc68847 WatchSource:0}: Error finding container fc4f8b417bffb06d8f290478b2ab45fee420ec8c4f0c6a04ecc169725bc68847: Status 404 returned error can't find the container with id fc4f8b417bffb06d8f290478b2ab45fee420ec8c4f0c6a04ecc169725bc68847
Jun 02 02:03:15.763140 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:15.763102    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88975744-bkzsc" event={"ID":"322bb65d-e623-4bae-9ea6-9c49ca3d4d6a","Type":"ContainerStarted","Data":"fc4f8b417bffb06d8f290478b2ab45fee420ec8c4f0c6a04ecc169725bc68847"}
Jun 02 02:03:17.771297 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.771258    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6965974ccc-sr7tf" event={"ID":"5cfc24f1-be50-4483-9e21-ebfadcc8db03","Type":"ContainerStarted","Data":"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"}
Jun 02 02:03:17.771723 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.771341    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:17.772577 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.772553    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88975744-bkzsc" event={"ID":"322bb65d-e623-4bae-9ea6-9c49ca3d4d6a","Type":"ContainerStarted","Data":"1f32286081fe35d08adbc2d446544c33ceea11a4075351503b3b048e13407d73"}
Jun 02 02:03:17.772686 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.772658    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:17.797022 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.796949    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6965974ccc-sr7tf" podStartSLOduration=1.142353832 podStartE2EDuration="3.796933801s" podCreationTimestamp="2026-06-02 02:03:14 +0000 UTC" firstStartedPulling="2026-06-02 02:03:14.617777879 +0000 UTC m=+753.969797605" lastFinishedPulling="2026-06-02 02:03:17.272357836 +0000 UTC m=+756.624377574" observedRunningTime="2026-06-02 02:03:17.794776451 +0000 UTC m=+757.146796200" watchObservedRunningTime="2026-06-02 02:03:17.796933801 +0000 UTC m=+757.148953554"
Jun 02 02:03:17.818479 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:17.818431    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-88975744-bkzsc" podStartSLOduration=1.33736235 podStartE2EDuration="3.818414007s" podCreationTimestamp="2026-06-02 02:03:14 +0000 UTC" firstStartedPulling="2026-06-02 02:03:14.801281087 +0000 UTC m=+754.153300817" lastFinishedPulling="2026-06-02 02:03:17.282332735 +0000 UTC m=+756.634352474" observedRunningTime="2026-06-02 02:03:17.81798517 +0000 UTC m=+757.170004921" watchObservedRunningTime="2026-06-02 02:03:17.818414007 +0000 UTC m=+757.170433757"
Jun 02 02:03:28.785323 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:28.785284    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-88975744-bkzsc"
Jun 02 02:03:28.785806 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:28.785355    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:28.856917 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:28.856885    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:28.857113 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:28.857073    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6965974ccc-sr7tf" podUID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" containerName="manager" containerID="cri-o://155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13" gracePeriod=30
Jun 02 02:03:29.107289 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.107258    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:29.172708 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.172679    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwpc6\" (UniqueName: \"kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6\") pod \"5cfc24f1-be50-4483-9e21-ebfadcc8db03\" (UID: \"5cfc24f1-be50-4483-9e21-ebfadcc8db03\") "
Jun 02 02:03:29.174914 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.174888    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6" (OuterVolumeSpecName: "kube-api-access-gwpc6") pod "5cfc24f1-be50-4483-9e21-ebfadcc8db03" (UID: "5cfc24f1-be50-4483-9e21-ebfadcc8db03"). InnerVolumeSpecName "kube-api-access-gwpc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:03:29.274091 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.274059    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwpc6\" (UniqueName: \"kubernetes.io/projected/5cfc24f1-be50-4483-9e21-ebfadcc8db03-kube-api-access-gwpc6\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:03:29.817936 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.817907    2567 generic.go:358] "Generic (PLEG): container finished" podID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" containerID="155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13" exitCode=0
Jun 02 02:03:29.818396 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.817971    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6965974ccc-sr7tf"
Jun 02 02:03:29.818396 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.817999    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6965974ccc-sr7tf" event={"ID":"5cfc24f1-be50-4483-9e21-ebfadcc8db03","Type":"ContainerDied","Data":"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"}
Jun 02 02:03:29.818396 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.818036    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6965974ccc-sr7tf" event={"ID":"5cfc24f1-be50-4483-9e21-ebfadcc8db03","Type":"ContainerDied","Data":"5016c27738ad7cb5686e46ed4c36d2aef20f038591d39ffe7b9aaf10f6b5c6b4"}
Jun 02 02:03:29.818396 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.818050    2567 scope.go:117] "RemoveContainer" containerID="155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"
Jun 02 02:03:29.825895 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.825869    2567 scope.go:117] "RemoveContainer" containerID="155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"
Jun 02 02:03:29.826177 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:29.826150    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13\": container with ID starting with 155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13 not found: ID does not exist" containerID="155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"
Jun 02 02:03:29.826285 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.826183    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13"} err="failed to get container status \"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13\": rpc error: code = NotFound desc = could not find container \"155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13\": container with ID starting with 155f3dacb4d8bb052bec5890aa4cf93e08b8d9efa7544f90712e249248f30d13 not found: ID does not exist"
Jun 02 02:03:29.838583 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.838560    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:29.842901 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:29.842882    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6965974ccc-sr7tf"]
Jun 02 02:03:31.212551 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:31.212509    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" path="/var/lib/kubelet/pods/5cfc24f1-be50-4483-9e21-ebfadcc8db03/volumes"
Jun 02 02:03:48.485246 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.485196    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6c97d786f-f8x8x"]
Jun 02 02:03:48.485597 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.485553    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" containerName="manager"
Jun 02 02:03:48.485597 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.485565    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" containerName="manager"
Jun 02 02:03:48.485664 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.485630    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cfc24f1-be50-4483-9e21-ebfadcc8db03" containerName="manager"
Jun 02 02:03:48.493752 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.493723    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:48.495697 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.495676    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 02 02:03:48.495826 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.495702    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ns9x5\""
Jun 02 02:03:48.495902 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.495889    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c97d786f-f8x8x"]
Jun 02 02:03:48.641151 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.641116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:48.641362 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.641188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsx6d\" (UniqueName: \"kubernetes.io/projected/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-kube-api-access-rsx6d\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:48.742200 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.742121    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:48.742200 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.742181    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsx6d\" (UniqueName: \"kubernetes.io/projected/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-kube-api-access-rsx6d\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:48.742396 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:48.742298    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 02 02:03:48.742396 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:03:48.742362    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls podName:0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99 nodeName:}" failed. No retries permitted until 2026-06-02 02:03:49.242346813 +0000 UTC m=+788.594366546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls") pod "maas-api-6c97d786f-f8x8x" (UID: "0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99") : secret "maas-api-serving-cert" not found
Jun 02 02:03:48.750588 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:48.750559    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsx6d\" (UniqueName: \"kubernetes.io/projected/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-kube-api-access-rsx6d\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:49.246433 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:49.246396    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:49.248809 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:49.248785    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99-maas-api-tls\") pod \"maas-api-6c97d786f-f8x8x\" (UID: \"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99\") " pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:49.404809 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:49.404774    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:49.536208 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:49.536181    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c97d786f-f8x8x"]
Jun 02 02:03:49.538492 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:03:49.538465    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2eb68b_4a3e_44eb_8bb4_c35b2e1f5f99.slice/crio-d33426ec5145e47b0dd97c5a3598e911830ed7eb2981a4a0734c38cfd9a13aaf WatchSource:0}: Error finding container d33426ec5145e47b0dd97c5a3598e911830ed7eb2981a4a0734c38cfd9a13aaf: Status 404 returned error can't find the container with id d33426ec5145e47b0dd97c5a3598e911830ed7eb2981a4a0734c38cfd9a13aaf
Jun 02 02:03:49.898004 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:49.897966    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c97d786f-f8x8x" event={"ID":"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99","Type":"ContainerStarted","Data":"d33426ec5145e47b0dd97c5a3598e911830ed7eb2981a4a0734c38cfd9a13aaf"}
Jun 02 02:03:51.906401 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:51.906362    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c97d786f-f8x8x" event={"ID":"0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99","Type":"ContainerStarted","Data":"452040177e76f3855c5ebfea65ac58774bc87f24397e265626dc10c912c93366"}
Jun 02 02:03:51.906791 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:51.906423    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:51.924825 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:51.924782    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6c97d786f-f8x8x" podStartSLOduration=2.049818486 podStartE2EDuration="3.924767464s" podCreationTimestamp="2026-06-02 02:03:48 +0000 UTC" firstStartedPulling="2026-06-02 02:03:49.540012917 +0000 UTC m=+788.892032644" lastFinishedPulling="2026-06-02 02:03:51.414961894 +0000 UTC m=+790.766981622" observedRunningTime="2026-06-02 02:03:51.923789574 +0000 UTC m=+791.275809325" watchObservedRunningTime="2026-06-02 02:03:51.924767464 +0000 UTC m=+791.276787212"
Jun 02 02:03:57.915603 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:57.915572    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6c97d786f-f8x8x"
Jun 02 02:03:59.714682 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:59.714650    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:03:59.715193 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:03:59.714876    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak" containerID="cri-o://431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b" gracePeriod=30
Jun 02 02:04:01.361604 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.361578    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:01.456341 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.456261    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2njl\" (UniqueName: \"kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl\") pod \"21102359-609a-46dd-a6ac-153023ae5313\" (UID: \"21102359-609a-46dd-a6ac-153023ae5313\") "
Jun 02 02:04:01.458292 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.458268    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl" (OuterVolumeSpecName: "kube-api-access-n2njl") pod "21102359-609a-46dd-a6ac-153023ae5313" (UID: "21102359-609a-46dd-a6ac-153023ae5313"). InnerVolumeSpecName "kube-api-access-n2njl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:04:01.557592 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.557560    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2njl\" (UniqueName: \"kubernetes.io/projected/21102359-609a-46dd-a6ac-153023ae5313-kube-api-access-n2njl\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:04:01.947880 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.947848    2567 generic.go:358] "Generic (PLEG): container finished" podID="21102359-609a-46dd-a6ac-153023ae5313" containerID="431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b" exitCode=143
Jun 02 02:04:01.948063 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.947911    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:01.948063 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.947935    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21102359-609a-46dd-a6ac-153023ae5313","Type":"ContainerDied","Data":"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"}
Jun 02 02:04:01.948063 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.947975    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21102359-609a-46dd-a6ac-153023ae5313","Type":"ContainerDied","Data":"e53d9fc2a0e9aba62524147e862738111340efeeab98094ea5f699d5d2673b5b"}
Jun 02 02:04:01.948063 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.947997    2567 scope.go:117] "RemoveContainer" containerID="431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"
Jun 02 02:04:01.963315 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.963290    2567 scope.go:117] "RemoveContainer" containerID="431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"
Jun 02 02:04:01.963581 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:04:01.963557    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b\": container with ID starting with 431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b not found: ID does not exist" containerID="431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"
Jun 02 02:04:01.963673 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.963585    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b"} err="failed to get container status \"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b\": rpc error: code = NotFound desc = could not find container \"431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b\": container with ID starting with 431229e549371a82c233d086e3cca62579a5cee228c25e9238001a15cc54547b not found: ID does not exist"
Jun 02 02:04:01.972440 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.972421    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:04:01.979930 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:01.979912    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:04:02.000821 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.000800    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:04:02.001147 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.001135    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak"
Jun 02 02:04:02.001191 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.001148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak"
Jun 02 02:04:02.001247 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.001238    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="21102359-609a-46dd-a6ac-153023ae5313" containerName="keycloak"
Jun 02 02:04:02.005530 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.005514    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.007744 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.007718    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 02 02:04:02.007847 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.007778    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 02 02:04:02.007847 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.007800    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 02 02:04:02.007968 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.007846    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2c8x2\""
Jun 02 02:04:02.007968 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.007803    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 02 02:04:02.012550 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.012527    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:04:02.060502 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.060474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-test-realms\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.060660 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.060534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwg9l\" (UniqueName: \"kubernetes.io/projected/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-kube-api-access-mwg9l\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.161852 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.161815    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-test-realms\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.161999 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.161877    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwg9l\" (UniqueName: \"kubernetes.io/projected/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-kube-api-access-mwg9l\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.162501 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.162483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-test-realms\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.170792 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.170761    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwg9l\" (UniqueName: \"kubernetes.io/projected/737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b-kube-api-access-mwg9l\") pod \"maas-keycloak-0\" (UID: \"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b\") " pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.316516 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.316440    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:02.442896 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.442871    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 02 02:04:02.444970 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:04:02.444936    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737dd9e4_fcf4_4061_8afe_ed0bc6c0bb7b.slice/crio-1223946d24c7e3a8d774e678e0a1b4e232338dc4c68c4810b6d7e701696f2a78 WatchSource:0}: Error finding container 1223946d24c7e3a8d774e678e0a1b4e232338dc4c68c4810b6d7e701696f2a78: Status 404 returned error can't find the container with id 1223946d24c7e3a8d774e678e0a1b4e232338dc4c68c4810b6d7e701696f2a78
Jun 02 02:04:02.954793 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.954755    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b","Type":"ContainerStarted","Data":"f4aa28a98a1a1ecf0b6e6f8a8cac974772905f6de239108f58705dce54df645e"}
Jun 02 02:04:02.954793 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.954793    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b","Type":"ContainerStarted","Data":"1223946d24c7e3a8d774e678e0a1b4e232338dc4c68c4810b6d7e701696f2a78"}
Jun 02 02:04:02.973443 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:02.973397    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.644154568 podStartE2EDuration="1.973381596s" podCreationTimestamp="2026-06-02 02:04:01 +0000 UTC" firstStartedPulling="2026-06-02 02:04:02.446393618 +0000 UTC m=+801.798413359" lastFinishedPulling="2026-06-02 02:04:02.775620655 +0000 UTC m=+802.127640387" observedRunningTime="2026-06-02 02:04:02.971320732 +0000 UTC m=+802.323340481" watchObservedRunningTime="2026-06-02 02:04:02.973381596 +0000 UTC m=+802.325401374"
Jun 02 02:04:03.214375 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:03.214335    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21102359-609a-46dd-a6ac-153023ae5313" path="/var/lib/kubelet/pods/21102359-609a-46dd-a6ac-153023ae5313/volumes"
Jun 02 02:04:03.317276 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:03.317236    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:03.318938 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:03.318903    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:04.317707 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:04.317646    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:05.317709 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:05.317666    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:06.316938 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:06.316880    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:07.317538 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:07.317490    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:08.318256 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:08.318190    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:09.317663 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:09.317611    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:10.317345 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:10.317289    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:11.317127 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:11.317076    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:12.317255 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:12.317192    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:12.317766 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:12.317565    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:13.317192 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:13.317125    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:14.317930 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:14.317885    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:15.317032 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:15.316984    2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 02 02:04:16.449422 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:16.449363    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:16.469699 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:16.469657    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="737dd9e4-fcf4-4061-8afe-ed0bc6c0bb7b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 02 02:04:26.455283 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:26.455247    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 02 02:04:37.125886 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.125853    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6964655b6-d68xh"]
Jun 02 02:04:37.129309 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.129287    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.131639 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.131614    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jun 02 02:04:37.137244 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.137208    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6964655b6-d68xh"]
Jun 02 02:04:37.201200 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.201167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-tls-cert\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.201363 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.201236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-oidc-ca\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.201363 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.201278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-kube-api-access-xw5j2\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.302470 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.302438    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-tls-cert\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.302615 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.302484    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-oidc-ca\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.302615 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.302516    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-kube-api-access-xw5j2\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.303168 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.303149    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-oidc-ca\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.304809 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.304789    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-tls-cert\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.310700 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.310681    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5j2\" (UniqueName: \"kubernetes.io/projected/ecbb7fb9-daa3-468c-80ff-73bf58f4ef18-kube-api-access-xw5j2\") pod \"authorino-6964655b6-d68xh\" (UID: \"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18\") " pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.438897 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.438858    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6964655b6-d68xh"
Jun 02 02:04:37.579634 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:37.579586    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6964655b6-d68xh"]
Jun 02 02:04:37.582310 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:04:37.582279    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecbb7fb9_daa3_468c_80ff_73bf58f4ef18.slice/crio-8068404d256da09651225eb2e95981a62dc383d64cbce5cadc561faeb7dbbd7d WatchSource:0}: Error finding container 8068404d256da09651225eb2e95981a62dc383d64cbce5cadc561faeb7dbbd7d: Status 404 returned error can't find the container with id 8068404d256da09651225eb2e95981a62dc383d64cbce5cadc561faeb7dbbd7d
Jun 02 02:04:38.092636 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.092595    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6964655b6-d68xh" event={"ID":"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18","Type":"ContainerStarted","Data":"fb1cf513fb6875f8b94d8cee64dd76fe156a230862480f34437132d597c2bf89"}
Jun 02 02:04:38.092636 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.092632    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6964655b6-d68xh" event={"ID":"ecbb7fb9-daa3-468c-80ff-73bf58f4ef18","Type":"ContainerStarted","Data":"8068404d256da09651225eb2e95981a62dc383d64cbce5cadc561faeb7dbbd7d"}
Jun 02 02:04:38.109943 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.109882    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6964655b6-d68xh" podStartSLOduration=0.704870498 podStartE2EDuration="1.109867551s" podCreationTimestamp="2026-06-02 02:04:37 +0000 UTC" firstStartedPulling="2026-06-02 02:04:37.583560146 +0000 UTC m=+836.935579873" lastFinishedPulling="2026-06-02 02:04:37.988557199 +0000 UTC m=+837.340576926" observedRunningTime="2026-06-02 02:04:38.106987007 +0000 UTC m=+837.459006781" watchObservedRunningTime="2026-06-02 02:04:38.109867551 +0000 UTC m=+837.461887300"
Jun 02 02:04:38.134257 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.134227    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:04:38.134670 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.134412    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" podUID="8c954f68-2c26-4be1-b36b-8010b587563b" containerName="authorino" containerID="cri-o://577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3" gracePeriod=30
Jun 02 02:04:38.418465 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.418434    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:04:38.513609 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.513528    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbsxc\" (UniqueName: \"kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc\") pod \"8c954f68-2c26-4be1-b36b-8010b587563b\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") "
Jun 02 02:04:38.513780 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.513624    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert\") pod \"8c954f68-2c26-4be1-b36b-8010b587563b\" (UID: \"8c954f68-2c26-4be1-b36b-8010b587563b\") "
Jun 02 02:04:38.515635 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.515593    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc" (OuterVolumeSpecName: "kube-api-access-pbsxc") pod "8c954f68-2c26-4be1-b36b-8010b587563b" (UID: "8c954f68-2c26-4be1-b36b-8010b587563b"). InnerVolumeSpecName "kube-api-access-pbsxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 02 02:04:38.523738 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.523702    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8c954f68-2c26-4be1-b36b-8010b587563b" (UID: "8c954f68-2c26-4be1-b36b-8010b587563b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 02 02:04:38.614375 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.614343    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbsxc\" (UniqueName: \"kubernetes.io/projected/8c954f68-2c26-4be1-b36b-8010b587563b-kube-api-access-pbsxc\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:04:38.614375 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:38.614369    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c954f68-2c26-4be1-b36b-8010b587563b-tls-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\""
Jun 02 02:04:39.103290 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.103252    2567 generic.go:358] "Generic (PLEG): container finished" podID="8c954f68-2c26-4be1-b36b-8010b587563b" containerID="577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3" exitCode=0
Jun 02 02:04:39.103451 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.103311    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6d74d6b-gkclp"
Jun 02 02:04:39.103451 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.103341    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" event={"ID":"8c954f68-2c26-4be1-b36b-8010b587563b","Type":"ContainerDied","Data":"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"}
Jun 02 02:04:39.103451 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.103377    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6d74d6b-gkclp" event={"ID":"8c954f68-2c26-4be1-b36b-8010b587563b","Type":"ContainerDied","Data":"fcd488e7bd736c6c080dbbc74490b68ca70c0aeb23f034d81e6dcc8753738914"}
Jun 02 02:04:39.103451 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.103397    2567 scope.go:117] "RemoveContainer" containerID="577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"
Jun 02 02:04:39.111839 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.111823    2567 scope.go:117] "RemoveContainer" containerID="577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"
Jun 02 02:04:39.112085 ip-10-0-138-87 kubenswrapper[2567]: E0602 02:04:39.112068    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3\": container with ID starting with 577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3 not found: ID does not exist" containerID="577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"
Jun 02 02:04:39.112131 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.112093    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3"} err="failed to get container status \"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3\": rpc error: code = NotFound desc = could not find container \"577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3\": container with ID starting with 577dc6cf7ddfa6dce0ba9eeda99bc0c7edc1e5e1b21e8a5970ac6d29ec7d7ea3 not found: ID does not exist"
Jun 02 02:04:39.123955 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.123931    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:04:39.127517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.127500    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b6d74d6b-gkclp"]
Jun 02 02:04:39.213139 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:39.213111    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c954f68-2c26-4be1-b36b-8010b587563b" path="/var/lib/kubelet/pods/8c954f68-2c26-4be1-b36b-8010b587563b/volumes"
Jun 02 02:04:48.025142 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.025105    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"]
Jun 02 02:04:48.025665 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.025645    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c954f68-2c26-4be1-b36b-8010b587563b" containerName="authorino"
Jun 02 02:04:48.025712 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.025670    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c954f68-2c26-4be1-b36b-8010b587563b" containerName="authorino"
Jun 02 02:04:48.025803 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.025791    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c954f68-2c26-4be1-b36b-8010b587563b" containerName="authorino"
Jun 02 02:04:48.030684 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.030659    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.033653 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.033627    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 02 02:04:48.033782 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.033657    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jq62q\""
Jun 02 02:04:48.033782 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.033706    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 02 02:04:48.033782 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.033660    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 02 02:04:48.041167 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.041143    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"]
Jun 02 02:04:48.091878 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.091849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tmf\" (UniqueName: \"kubernetes.io/projected/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kube-api-access-g4tmf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.092024 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.091942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55ef50a0-111f-46a7-8b68-3f4381f42cc3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.092024 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.091970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.092024 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.091999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.092024 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.092014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.092205 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.092039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192576 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192546    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tmf\" (UniqueName: \"kubernetes.io/projected/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kube-api-access-g4tmf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192728 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192606    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55ef50a0-111f-46a7-8b68-3f4381f42cc3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192728 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192628    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192728 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192651    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192728 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192667    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.192728 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.192688    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.193099 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.193078    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.193173 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.193139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.193244 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.193171    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.195021 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.195004    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55ef50a0-111f-46a7-8b68-3f4381f42cc3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.195087 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.195047    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55ef50a0-111f-46a7-8b68-3f4381f42cc3-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.200739 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.200713    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tmf\" (UniqueName: \"kubernetes.io/projected/55ef50a0-111f-46a7-8b68-3f4381f42cc3-kube-api-access-g4tmf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt\" (UID: \"55ef50a0-111f-46a7-8b68-3f4381f42cc3\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.342848 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.342769    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:04:48.483877 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:48.483847    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"]
Jun 02 02:04:48.487207 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:04:48.487180    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ef50a0_111f_46a7_8b68_3f4381f42cc3.slice/crio-684f63f5bdff8eb3d420b8ee8e1ce9d389580868d0ffd88a652212e04ad75635 WatchSource:0}: Error finding container 684f63f5bdff8eb3d420b8ee8e1ce9d389580868d0ffd88a652212e04ad75635: Status 404 returned error can't find the container with id 684f63f5bdff8eb3d420b8ee8e1ce9d389580868d0ffd88a652212e04ad75635
Jun 02 02:04:49.140689 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:49.140650    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt" event={"ID":"55ef50a0-111f-46a7-8b68-3f4381f42cc3","Type":"ContainerStarted","Data":"684f63f5bdff8eb3d420b8ee8e1ce9d389580868d0ffd88a652212e04ad75635"}
Jun 02 02:04:53.157432 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:04:53.157397    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt" event={"ID":"55ef50a0-111f-46a7-8b68-3f4381f42cc3","Type":"ContainerStarted","Data":"ae942504faaa67e9734ea137477d76513d0727de1d2953b2a7dd882857838952"}
Jun 02 02:05:06.591049 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.591011    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"]
Jun 02 02:05:06.598052 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.598030    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.600337 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.600310    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 02 02:05:06.603445 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.603422    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"]
Jun 02 02:05:06.660223 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.660415 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660264    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.660415 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmqdh\" (UniqueName: \"kubernetes.io/projected/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kube-api-access-zmqdh\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.660415 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.660415 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.660607 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.660502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761196 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761158    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761404 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761321    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761404 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761354    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761404 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761371    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmqdh\" (UniqueName: \"kubernetes.io/projected/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kube-api-access-zmqdh\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761404 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761389    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761404 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761407    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761753 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761723    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761846 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761782    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.761846 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.761829    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.763603 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.763572    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.763817 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.763798    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.773917 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.773895    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmqdh\" (UniqueName: \"kubernetes.io/projected/8bbacd6d-b564-4c0a-9f69-8f8ad9f60627-kube-api-access-zmqdh\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr\" (UID: \"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:06.910941 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:06.910909    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:07.042825 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:07.042799    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"]
Jun 02 02:05:07.045289 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:05:07.045259    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbacd6d_b564_4c0a_9f69_8f8ad9f60627.slice/crio-52944f4a397dfbf7eada0ab9410739387b575cb8342d10d7c3bfd70ac2d8d4c5 WatchSource:0}: Error finding container 52944f4a397dfbf7eada0ab9410739387b575cb8342d10d7c3bfd70ac2d8d4c5: Status 404 returned error can't find the container with id 52944f4a397dfbf7eada0ab9410739387b575cb8342d10d7c3bfd70ac2d8d4c5
Jun 02 02:05:07.213497 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:07.213419    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr" event={"ID":"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627","Type":"ContainerStarted","Data":"a0b10d0927837fd25314845b0304899985655e8d65a9baeed0ab61ed5bea853a"}
Jun 02 02:05:07.213497 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:07.213457    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr" event={"ID":"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627","Type":"ContainerStarted","Data":"52944f4a397dfbf7eada0ab9410739387b575cb8342d10d7c3bfd70ac2d8d4c5"}
Jun 02 02:05:09.221481 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:09.221447    2567 generic.go:358] "Generic (PLEG): container finished" podID="8bbacd6d-b564-4c0a-9f69-8f8ad9f60627" containerID="a0b10d0927837fd25314845b0304899985655e8d65a9baeed0ab61ed5bea853a" exitCode=0
Jun 02 02:05:09.221989 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:09.221515    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr" event={"ID":"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627","Type":"ContainerDied","Data":"a0b10d0927837fd25314845b0304899985655e8d65a9baeed0ab61ed5bea853a"}
Jun 02 02:05:10.110502 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.110461    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"]
Jun 02 02:05:10.114605 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.114579    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.116649 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.116625    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 02 02:05:10.122250 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.122205    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"]
Jun 02 02:05:10.191927 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.191894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8r4p\" (UniqueName: \"kubernetes.io/projected/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kube-api-access-p8r4p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.192119 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.191944    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.192119 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.192025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.192119 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.192053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.192119 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.192082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.192363 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.192205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a9402f-7d67-4c6a-be36-f2451f2e4343-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.293726 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293691    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293749    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293797    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a9402f-7d67-4c6a-be36-f2451f2e4343-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293905    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8r4p\" (UniqueName: \"kubernetes.io/projected/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kube-api-access-p8r4p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293934    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.293984    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.294179    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294240 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.294200    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.294648 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.294397    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.296610 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.296588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a9402f-7d67-4c6a-be36-f2451f2e4343-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.296779 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.296754    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a9402f-7d67-4c6a-be36-f2451f2e4343-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.302234 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.302191    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8r4p\" (UniqueName: \"kubernetes.io/projected/a9a9402f-7d67-4c6a-be36-f2451f2e4343-kube-api-access-p8r4p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4\" (UID: \"a9a9402f-7d67-4c6a-be36-f2451f2e4343\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.428535 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.428508    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:10.570887 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:10.570848    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"]
Jun 02 02:05:10.573573 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:05:10.573546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a9402f_7d67_4c6a_be36_f2451f2e4343.slice/crio-7dade1a292ce25f57086c051ad1e651fe17f9abbe405c63f3ba3aa778421fa32 WatchSource:0}: Error finding container 7dade1a292ce25f57086c051ad1e651fe17f9abbe405c63f3ba3aa778421fa32: Status 404 returned error can't find the container with id 7dade1a292ce25f57086c051ad1e651fe17f9abbe405c63f3ba3aa778421fa32
Jun 02 02:05:11.230796 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.230756    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4" event={"ID":"a9a9402f-7d67-4c6a-be36-f2451f2e4343","Type":"ContainerStarted","Data":"dd3fd37536b57f56eb7170326876208ed6203272581a6609a67a745adb4c9514"}
Jun 02 02:05:11.230796 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.230798    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4" event={"ID":"a9a9402f-7d67-4c6a-be36-f2451f2e4343","Type":"ContainerStarted","Data":"7dade1a292ce25f57086c051ad1e651fe17f9abbe405c63f3ba3aa778421fa32"}
Jun 02 02:05:11.232150 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.232123    2567 generic.go:358] "Generic (PLEG): container finished" podID="55ef50a0-111f-46a7-8b68-3f4381f42cc3" containerID="ae942504faaa67e9734ea137477d76513d0727de1d2953b2a7dd882857838952" exitCode=0
Jun 02 02:05:11.232291 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.232194    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt" event={"ID":"55ef50a0-111f-46a7-8b68-3f4381f42cc3","Type":"ContainerDied","Data":"ae942504faaa67e9734ea137477d76513d0727de1d2953b2a7dd882857838952"}
Jun 02 02:05:11.233926 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.233901    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr" event={"ID":"8bbacd6d-b564-4c0a-9f69-8f8ad9f60627","Type":"ContainerStarted","Data":"03bbedd29c9088b874161f32a1dd309f860f995f5a266af64e8b8a9979b7da2c"}
Jun 02 02:05:11.287965 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:11.287861    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr" podStartSLOduration=4.114714694 podStartE2EDuration="5.287841483s" podCreationTimestamp="2026-06-02 02:05:06 +0000 UTC" firstStartedPulling="2026-06-02 02:05:09.222140523 +0000 UTC m=+868.574160250" lastFinishedPulling="2026-06-02 02:05:10.395267308 +0000 UTC m=+869.747287039" observedRunningTime="2026-06-02 02:05:11.2863717 +0000 UTC m=+870.638391449" watchObservedRunningTime="2026-06-02 02:05:11.287841483 +0000 UTC m=+870.639861232"
Jun 02 02:05:12.238737 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:12.238644    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt" event={"ID":"55ef50a0-111f-46a7-8b68-3f4381f42cc3","Type":"ContainerStarted","Data":"02fac11aaa1fae83a109df68935d2547ee4b3f059b09cf6281f70a1ac2b27102"}
Jun 02 02:05:12.239992 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:12.239965    2567 generic.go:358] "Generic (PLEG): container finished" podID="a9a9402f-7d67-4c6a-be36-f2451f2e4343" containerID="dd3fd37536b57f56eb7170326876208ed6203272581a6609a67a745adb4c9514" exitCode=0
Jun 02 02:05:12.240123 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:12.240015    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4" event={"ID":"a9a9402f-7d67-4c6a-be36-f2451f2e4343","Type":"ContainerDied","Data":"dd3fd37536b57f56eb7170326876208ed6203272581a6609a67a745adb4c9514"}
Jun 02 02:05:12.255578 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:12.255534    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt" podStartSLOduration=1.250557171 podStartE2EDuration="24.255522597s" podCreationTimestamp="2026-06-02 02:04:48 +0000 UTC" firstStartedPulling="2026-06-02 02:04:48.489171548 +0000 UTC m=+847.841191278" lastFinishedPulling="2026-06-02 02:05:11.494136975 +0000 UTC m=+870.846156704" observedRunningTime="2026-06-02 02:05:12.254442411 +0000 UTC m=+871.606462159" watchObservedRunningTime="2026-06-02 02:05:12.255522597 +0000 UTC m=+871.607542344"
Jun 02 02:05:13.245144 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:13.245108    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4" event={"ID":"a9a9402f-7d67-4c6a-be36-f2451f2e4343","Type":"ContainerStarted","Data":"20f11d42f7dee9d55cb519792532f93a9a9e2ca93fc78a7bfdf5dff91686c444"}
Jun 02 02:05:13.262487 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:13.262437    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4" podStartSLOduration=2.7291371030000002 podStartE2EDuration="3.262422962s" podCreationTimestamp="2026-06-02 02:05:10 +0000 UTC" firstStartedPulling="2026-06-02 02:05:12.240494413 +0000 UTC m=+871.592514139" lastFinishedPulling="2026-06-02 02:05:12.773780264 +0000 UTC m=+872.125799998" observedRunningTime="2026-06-02 02:05:13.261993561 +0000 UTC m=+872.614013310" watchObservedRunningTime="2026-06-02 02:05:13.262422962 +0000 UTC m=+872.614442711"
Jun 02 02:05:14.810624 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.810586    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"]
Jun 02 02:05:14.815114 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.815090    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.817206 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.817184    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 02 02:05:14.824204 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.824174    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"]
Jun 02 02:05:14.933477 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.933477 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933483    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.933740 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.933740 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnvj4\" (UniqueName: \"kubernetes.io/projected/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kube-api-access-hnvj4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.933740 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:14.933740 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:14.933685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.034830 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034791    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.034830 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034833    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035074 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034865    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035074 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034911    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnvj4\" (UniqueName: \"kubernetes.io/projected/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kube-api-access-hnvj4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035074 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034958    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035074 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.034981    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035340 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.035312    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035411 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.035360    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.035459 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.035409    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.037113 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.037089    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.037377 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.037362    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.043384 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.043367    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnvj4\" (UniqueName: \"kubernetes.io/projected/2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9-kube-api-access-hnvj4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq\" (UID: \"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.126586 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.126508    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:15.257111 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:15.257083    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"]
Jun 02 02:05:15.259671 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:05:15.259642    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc4ec4c_0fee_4bb9_b4f3_d19d66e463e9.slice/crio-071b555897f1de8f78547f74bc0960a5d3425fbe49a78a4d53a74ec54301aa37 WatchSource:0}: Error finding container 071b555897f1de8f78547f74bc0960a5d3425fbe49a78a4d53a74ec54301aa37: Status 404 returned error can't find the container with id 071b555897f1de8f78547f74bc0960a5d3425fbe49a78a4d53a74ec54301aa37
Jun 02 02:05:16.256331 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:16.256294    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq" event={"ID":"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9","Type":"ContainerStarted","Data":"dd179794d3690df959d89789bf1b75a9abd4dcaee9bf0d98cbba1d61a4b0c5e1"}
Jun 02 02:05:16.256729 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:16.256334    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq" event={"ID":"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9","Type":"ContainerStarted","Data":"071b555897f1de8f78547f74bc0960a5d3425fbe49a78a4d53a74ec54301aa37"}
Jun 02 02:05:16.911397 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:16.911357    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:16.911397 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:16.911407    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:16.924426 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:16.924398    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:17.266604 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:17.266509    2567 generic.go:358] "Generic (PLEG): container finished" podID="2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9" containerID="dd179794d3690df959d89789bf1b75a9abd4dcaee9bf0d98cbba1d61a4b0c5e1" exitCode=0
Jun 02 02:05:17.266604 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:17.266588    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq" event={"ID":"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9","Type":"ContainerDied","Data":"dd179794d3690df959d89789bf1b75a9abd4dcaee9bf0d98cbba1d61a4b0c5e1"}
Jun 02 02:05:17.279808 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:17.279786    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr"
Jun 02 02:05:18.272039 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:18.272003    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq" event={"ID":"2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9","Type":"ContainerStarted","Data":"1e1357d49b5fb28fc79430ec3a6a58f4d31892dbaff9c9d66cac6cc9ff40c0ca"}
Jun 02 02:05:18.290598 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:18.290551    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq" podStartSLOduration=3.9221142159999998 podStartE2EDuration="4.29053741s" podCreationTimestamp="2026-06-02 02:05:14 +0000 UTC" firstStartedPulling="2026-06-02 02:05:17.267241406 +0000 UTC m=+876.619261133" lastFinishedPulling="2026-06-02 02:05:17.635664586 +0000 UTC m=+876.987684327" observedRunningTime="2026-06-02 02:05:18.287950244 +0000 UTC m=+877.639969994" watchObservedRunningTime="2026-06-02 02:05:18.29053741 +0000 UTC m=+877.642557158"
Jun 02 02:05:18.342890 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:18.342862    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:05:18.343033 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:18.342901    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:05:18.354968 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:18.354945    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:05:19.287266 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:19.287237    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt"
Jun 02 02:05:20.428662 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:20.428618    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:20.428662 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:20.428662    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:20.441323 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:20.441286    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:21.293806 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:21.293780    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4"
Jun 02 02:05:25.127111 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:25.127049    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:25.127535 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:25.127234    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:25.139644 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:25.139617    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:25.307771 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:25.307744    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq"
Jun 02 02:05:41.186266 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:41.186239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:05:41.188623 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:05:41.188605    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:10:41.214797 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:10:41.214768    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:10:41.217307 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:10:41.217287    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qzsbw_c22e122d-74a1-4803-8529-6655e2a6abd2/ovn-acl-logging/0.log"
Jun 02 02:11:42.460380 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:42.460348    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6964655b6-d68xh_ecbb7fb9-daa3-468c-80ff-73bf58f4ef18/authorino/0.log"
Jun 02 02:11:47.392339 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:47.392310    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c97d786f-f8x8x_0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99/maas-api/0.log"
Jun 02 02:11:47.506304 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:47.506272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-88975744-bkzsc_322bb65d-e623-4bae-9ea6-9c49ca3d4d6a/manager/0.log"
Jun 02 02:11:47.954499 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:47.954472    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-f5tjt_67fad6aa-b849-4f8b-96b3-d6315eb018a8/copy-manifests/0.log"
Jun 02 02:11:47.966674 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:47.966648    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-f5tjt_67fad6aa-b849-4f8b-96b3-d6315eb018a8/manager/0.log"
Jun 02 02:11:49.410857 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:49.410827    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6964655b6-d68xh_ecbb7fb9-daa3-468c-80ff-73bf58f4ef18/authorino/0.log"
Jun 02 02:11:49.536141 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:49.536104    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wspzr_e0d5609f-df08-4d16-9939-c57316e9a3be/manager/0.log"
Jun 02 02:11:49.754939 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:49.754865    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-lwl2w_5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374/kuadrant-console-plugin/0.log"
Jun 02 02:11:50.888900 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:50.888868    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f895b8b-kmd52_46df8ebf-7ebc-4d29-9f18-52adc97459f9/kube-auth-proxy/0.log"
Jun 02 02:11:51.701892 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:51.701859    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt_55ef50a0-111f-46a7-8b68-3f4381f42cc3/main/0.log"
Jun 02 02:11:51.709350 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:51.709328    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-5zfjt_55ef50a0-111f-46a7-8b68-3f4381f42cc3/storage-initializer/0.log"
Jun 02 02:11:51.961807 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:51.961733    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr_8bbacd6d-b564-4c0a-9f69-8f8ad9f60627/storage-initializer/0.log"
Jun 02 02:11:51.968317 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:51.968294    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-dtslr_8bbacd6d-b564-4c0a-9f69-8f8ad9f60627/main/0.log"
Jun 02 02:11:52.082437 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:52.082394    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4_a9a9402f-7d67-4c6a-be36-f2451f2e4343/storage-initializer/0.log"
Jun 02 02:11:52.089983 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:52.089959    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9g4st4_a9a9402f-7d67-4c6a-be36-f2451f2e4343/main/0.log"
Jun 02 02:11:52.196296 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:52.196267    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq_2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9/storage-initializer/0.log"
Jun 02 02:11:52.202905 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:52.202882    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-66sdq_2dc4ec4c-0fee-4bb9-b4f3-d19d66e463e9/main/0.log"
Jun 02 02:11:59.274592 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:59.274565    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2fqc8_3941037e-03f5-40db-bd45-0f16ddbd25c9/global-pull-secret-syncer/0.log"
Jun 02 02:11:59.565390 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:59.565318    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nkfll_fefbcfff-9796-44fe-a176-0e9d272bb56c/konnectivity-agent/0.log"
Jun 02 02:11:59.619701 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:11:59.619673    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-87.ec2.internal_33a4f9a04dffa76a96184c86815a9643/haproxy/0.log"
Jun 02 02:12:03.211623 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:03.211592    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6964655b6-d68xh_ecbb7fb9-daa3-468c-80ff-73bf58f4ef18/authorino/0.log"
Jun 02 02:12:03.248332 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:03.248300    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wspzr_e0d5609f-df08-4d16-9939-c57316e9a3be/manager/0.log"
Jun 02 02:12:03.322641 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:03.322617    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-lwl2w_5cc4e5ce-0bf8-4fd5-8b9a-2d2cb270c374/kuadrant-console-plugin/0.log"
Jun 02 02:12:05.133073 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.133037    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65485857c6-pvgkf_81d698e0-bfe0-4f7c-a66e-646efa80c67e/metrics-server/0.log"
Jun 02 02:12:05.467632 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.467602    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/node-exporter/0.log"
Jun 02 02:12:05.520998 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.520969    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/kube-rbac-proxy/0.log"
Jun 02 02:12:05.561361 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.561333    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wv5p5_fcc723b7-20de-44d4-983c-4a4d0d38bff2/init-textfile/0.log"
Jun 02 02:12:05.720694 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.720600    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/prometheus/0.log"
Jun 02 02:12:05.749380 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.749357    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/config-reloader/0.log"
Jun 02 02:12:05.790484 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.790465    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/thanos-sidecar/0.log"
Jun 02 02:12:05.818436 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.818411    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/kube-rbac-proxy-web/0.log"
Jun 02 02:12:05.848747 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.848722    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/kube-rbac-proxy/0.log"
Jun 02 02:12:05.878360 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.878336    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/kube-rbac-proxy-thanos/0.log"
Jun 02 02:12:05.915110 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:05.915090    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4cd8c9b1-7490-48eb-95f3-9ea53135c206/init-config-reloader/0.log"
Jun 02 02:12:06.176511 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.176488    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/thanos-query/0.log"
Jun 02 02:12:06.204641 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.204609    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-web/0.log"
Jun 02 02:12:06.235041 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.235015    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy/0.log"
Jun 02 02:12:06.270517 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.270493    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/prom-label-proxy/0.log"
Jun 02 02:12:06.303016 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.302991    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-rules/0.log"
Jun 02 02:12:06.329535 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:06.329508    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d865f9465-kntjr_b89ecf48-fe8c-417d-b2b0-538a03dfbae6/kube-rbac-proxy-metrics/0.log"
Jun 02 02:12:07.534972 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:07.534944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-trxxg_bbbe9a16-49f7-4add-aa2d-0336c8019121/networking-console-plugin/0.log"
Jun 02 02:12:08.706172 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.706143    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-48wzn_ee9631cf-8377-4ed6-81cd-ff79b08f19d0/download-server/0.log"
Jun 02 02:12:08.929884 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.929838    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"]
Jun 02 02:12:08.933417 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.933397    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:08.936675 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.936642    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"kube-root-ca.crt\""
Jun 02 02:12:08.936675 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.936660    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"openshift-service-ca.crt\""
Jun 02 02:12:08.936832 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.936646    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kl4qd\"/\"default-dockercfg-pzj7r\""
Jun 02 02:12:08.941363 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:08.941340    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"]
Jun 02 02:12:09.005117 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.005015    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-proc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.005117 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.005049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25bfc\" (UniqueName: \"kubernetes.io/projected/46d0d47c-1921-4448-b486-3055d7650a07-kube-api-access-25bfc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.005117 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.005107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-lib-modules\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.005398 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.005155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-sys\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.005398 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.005191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-podres\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106401 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106367    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-podres\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106562 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106417    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-proc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106562 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106462    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25bfc\" (UniqueName: \"kubernetes.io/projected/46d0d47c-1921-4448-b486-3055d7650a07-kube-api-access-25bfc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106562 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106535    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-lib-modules\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106715 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106601    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-podres\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106715 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106617    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-proc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106715 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106628    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-sys\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106715 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106697    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-lib-modules\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.106863 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.106742    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d0d47c-1921-4448-b486-3055d7650a07-sys\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.115090 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.115063    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25bfc\" (UniqueName: \"kubernetes.io/projected/46d0d47c-1921-4448-b486-3055d7650a07-kube-api-access-25bfc\") pod \"perf-node-gather-daemonset-sg2wq\" (UID: \"46d0d47c-1921-4448-b486-3055d7650a07\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.244252 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.244207    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.378048 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.378027    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"]
Jun 02 02:12:09.380483 ip-10-0-138-87 kubenswrapper[2567]: W0602 02:12:09.380456    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod46d0d47c_1921_4448_b486_3055d7650a07.slice/crio-bfd7b94475851f2fbb53cc8548f3342e3a8ab7db809833d36acb891c5dbc517b WatchSource:0}: Error finding container bfd7b94475851f2fbb53cc8548f3342e3a8ab7db809833d36acb891c5dbc517b: Status 404 returned error can't find the container with id bfd7b94475851f2fbb53cc8548f3342e3a8ab7db809833d36acb891c5dbc517b
Jun 02 02:12:09.382125 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.382107    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 02 02:12:09.746356 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.746321    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq" event={"ID":"46d0d47c-1921-4448-b486-3055d7650a07","Type":"ContainerStarted","Data":"17440e87e3f6275835c660b30f7945b61cbb34047c286cbf9e7f598f02737eac"}
Jun 02 02:12:09.746356 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.746359    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq" event={"ID":"46d0d47c-1921-4448-b486-3055d7650a07","Type":"ContainerStarted","Data":"bfd7b94475851f2fbb53cc8548f3342e3a8ab7db809833d36acb891c5dbc517b"}
Jun 02 02:12:09.746795 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.746375    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:09.764895 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:09.764848    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq" podStartSLOduration=1.764833683 podStartE2EDuration="1.764833683s" podCreationTimestamp="2026-06-02 02:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:12:09.762301704 +0000 UTC m=+1289.114321453" watchObservedRunningTime="2026-06-02 02:12:09.764833683 +0000 UTC m=+1289.116853431"
Jun 02 02:12:10.225177 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.225144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfxxl_eadbf4e3-85da-4def-ad0a-10806f3a7620/dns/0.log"
Jun 02 02:12:10.249653 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.249628    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfxxl_eadbf4e3-85da-4def-ad0a-10806f3a7620/kube-rbac-proxy/0.log"
Jun 02 02:12:10.354252 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.354208    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lhz4g_0c14d0ec-f8ba-4ebb-baac-f3c28b25ae84/dns-node-resolver/0.log"
Jun 02 02:12:10.870292 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.870260    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9cfbffb4-dvbl5_3ee63f14-72b9-447c-bcb2-d4170d17738b/registry/1.log"
Jun 02 02:12:10.873791 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.873771    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9cfbffb4-dvbl5_3ee63f14-72b9-447c-bcb2-d4170d17738b/registry/2.log"
Jun 02 02:12:10.894648 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:10.894624    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5lzzb_508a812b-d86e-4f50-a437-b605c2b433ee/node-ca/0.log"
Jun 02 02:12:12.000116 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:12.000089    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f895b8b-kmd52_46df8ebf-7ebc-4d29-9f18-52adc97459f9/kube-auth-proxy/0.log"
Jun 02 02:12:12.737805 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:12.737764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hcmq7_ac3dccf4-a0bf-4842-a256-886a277947bb/serve-healthcheck-canary/0.log"
Jun 02 02:12:13.216944 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:13.216917    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dwswb_7c7b5ebc-d3df-41a4-9428-1f44a2c22518/insights-operator/0.log"
Jun 02 02:12:13.218883 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:13.218864    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dwswb_7c7b5ebc-d3df-41a4-9428-1f44a2c22518/insights-operator/1.log"
Jun 02 02:12:13.319584 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:13.319556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdgnm_f48eb265-b1d8-4d60-a59c-5cf2a11e8821/kube-rbac-proxy/0.log"
Jun 02 02:12:13.342189 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:13.342164    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdgnm_f48eb265-b1d8-4d60-a59c-5cf2a11e8821/exporter/0.log"
Jun 02 02:12:13.365402 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:13.365373    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdgnm_f48eb265-b1d8-4d60-a59c-5cf2a11e8821/extractor/0.log"
Jun 02 02:12:15.759956 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:15.759931    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c97d786f-f8x8x_0d2eb68b-4a3e-44eb-8bb4-c35b2e1f5f99/maas-api/0.log"
Jun 02 02:12:15.760747 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:15.760731    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-sg2wq"
Jun 02 02:12:15.798831 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:15.798801    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-88975744-bkzsc_322bb65d-e623-4bae-9ea6-9c49ca3d4d6a/manager/0.log"
Jun 02 02:12:16.004807 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:16.004764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-f5tjt_67fad6aa-b849-4f8b-96b3-d6315eb018a8/manager/0.log"
Jun 02 02:12:16.035369 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:16.035294    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-f5tjt_67fad6aa-b849-4f8b-96b3-d6315eb018a8/copy-manifests/0.log"
Jun 02 02:12:17.546137 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:17.546108    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f66fcb844-v8hzg_1bc36480-fd3d-48e9-81e4-a7634aacb94c/manager/0.log"
Jun 02 02:12:22.622163 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:22.622133    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-stz44_b7fd9311-8af0-489d-95b0-4a01d5391bbf/migrator/0.log"
Jun 02 02:12:22.645814 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:22.645786    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-stz44_b7fd9311-8af0-489d-95b0-4a01d5391bbf/graceful-termination/0.log"
Jun 02 02:12:24.039849 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.039824    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/kube-multus-additional-cni-plugins/0.log"
Jun 02 02:12:24.066260 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.066210    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/egress-router-binary-copy/0.log"
Jun 02 02:12:24.097898 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.097870    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/cni-plugins/0.log"
Jun 02 02:12:24.123788 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.123760    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/bond-cni-plugin/0.log"
Jun 02 02:12:24.149133 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.149108    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/routeoverride-cni/0.log"
Jun 02 02:12:24.183177 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.183149    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/whereabouts-cni-bincopy/0.log"
Jun 02 02:12:24.210632 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.210604    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z464_e9386f7d-5f0f-48ab-8378-e577c0d87974/whereabouts-cni/0.log"
Jun 02 02:12:24.696660 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.696624    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhw7h_5e2dd75b-7fb6-4651-89b5-5d875bd66a64/kube-multus/0.log"
Jun 02 02:12:24.758022 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.757994    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-495wn_0b7ea8cb-95b7-4640-b843-efe09587073c/network-metrics-daemon/0.log"
Jun 02 02:12:24.808017 ip-10-0-138-87 kubenswrapper[2567]: I0602 02:12:24.807992    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-495wn_0b7ea8cb-95b7-4640-b843-efe09587073c/kube-rbac-proxy/0.log"