Jun 03 19:27:51.354597 ip-10-0-128-21 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 19:27:51.354609 ip-10-0-128-21 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 19:27:51.354616 ip-10-0-128-21 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 19:27:51.354767 ip-10-0-128-21 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 19:28:02.580150 ip-10-0-128-21 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 19:28:02.580189 ip-10-0-128-21 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 68f30704a8934f7e80489a2bf86a7d2d --
Jun 03 19:30:46.265064 ip-10-0-128-21 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 19:30:46.668921 ip-10-0-128-21 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:30:46.668921 ip-10-0-128-21 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 19:30:46.668921 ip-10-0-128-21 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:30:46.668921 ip-10-0-128-21 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 19:30:46.668921 ip-10-0-128-21 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:30:46.669603 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.668974    2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 19:30:46.672544 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672526    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.672544 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672542    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.672544 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672545    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672549    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672554    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672557    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672560    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672563    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672566    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672569    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672571    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672575    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672577    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672580    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672583    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672585    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672588    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672591    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672594    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672596    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672599    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672602    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.672651 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672604    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672607    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672609    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672612    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672615    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672617    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672620    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672622    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672624    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672627    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672630    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672633    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672635    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672638    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672641    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672645    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672648    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672650    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672653    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672657    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.673138 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672660    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672662    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672665    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672668    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672670    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672672    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672675    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672677    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672680    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672682    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672685    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672687    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672690    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672692    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672695    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672699    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672701    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672704    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672707    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672709    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.673633 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672712    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672714    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672717    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672719    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672722    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672724    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672728    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672732    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672735    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672739    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672742    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672744    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672747    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672750    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672752    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672755    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672770    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672773    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672775    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.674171 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672778    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672781    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672785    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672789    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672793    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672796    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672799    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672803    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672806    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672809    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672812    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672814    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672817    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672820    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672822    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672824    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.672827    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673523    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673529    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.674623 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673533    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673535    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673538    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673543    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673548    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673551    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673555    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673559    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673562    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673564    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673567    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673570    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673573    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673575    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673578    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673581    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673583    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673586    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673588    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.675089 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673591    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673593    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673596    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673598    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673601    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673603    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673606    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673609    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673612    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673614    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673617    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673619    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673622    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673626    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673629    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673632    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673634    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673637    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673640    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673643    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.675566 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673646    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673649    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673651    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673654    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673657    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673659    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673661    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673664    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673667    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673669    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673672    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673674    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673677    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673679    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673682    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673684    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673687    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673689    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673693    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.676067 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673696    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673699    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673702    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673704    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673707    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673710    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673716    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673719    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673722    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673724    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673727    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673730    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673734    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673737    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673739    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673742    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673745    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673747    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673750    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.676518 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673752    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673772    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673775    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673778    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673780    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673783    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673786    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673788    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673791    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673793    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673796    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673799    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673802    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673804    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673807    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673809    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673812    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673815    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.673817    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674180    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.676993 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674185    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674188    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674190    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674193    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674196    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674199    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674201    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674204    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674207    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674209    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674212    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674215    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674217    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674220    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674222    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674225    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674227    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674230    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674232    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674235    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.677487 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674237    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674240    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674242    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674245    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674248    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674250    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674253    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674256    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674259    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674261    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674264    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674267    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674269    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674272    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674274    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674277    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674279    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674282    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674285    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674288    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.678014 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674291    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674293    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674295    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674298    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674301    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674303    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674305    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674308    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674310    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674313    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674316    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674318    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674321    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674323    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674326    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674328    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674331    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674334    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674336    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.678498 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674341    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674345    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674348    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674351    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674354    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674356    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674359    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674361    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674364    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674367    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674370    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674373    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674377    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674379    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674382    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674384    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674388    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674390    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674393    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674395    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.678989 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674398    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674400    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674403    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674405    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674408    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674410    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674413    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674417    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674421    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674424    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674427    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674429    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674432    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674434    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674437    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674439    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674442    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.674445    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674516    2549 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674524    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 19:30:46.679513 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674530    2549 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674535    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674539    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674543    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674547    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674552    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674555    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674559    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674563    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674566    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674569    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674572    2549 flags.go:64] FLAG: --cgroup-root=""
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674575    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674578    2549 flags.go:64] FLAG: --client-ca-file=""
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674581    2549 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674584    2549 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674589    2549 flags.go:64] FLAG: --cluster-domain=""
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674591    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674595    2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674598    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674601    2549 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674606    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674609    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 19:30:46.679999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674612    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674615    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674618    2549 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674621    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674624    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674628    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674631    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674635    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674638    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674642    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674645    2549 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674648    2549 flags.go:64] FLAG: --enable-server="true"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674651    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674658    2549 flags.go:64] FLAG: --event-burst="100"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674661    2549 flags.go:64] FLAG: --event-qps="50"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674664    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674668    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674671    2549 flags.go:64] FLAG: --eviction-hard=""
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674675    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674678    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674681    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674684    2549 flags.go:64] FLAG: --eviction-soft=""
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674687    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674689    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674694    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 19:30:46.680554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674697    2549 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674700    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674703    2549 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674705    2549 flags.go:64] FLAG: --feature-gates=""
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674709    2549 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674750    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674754    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674772    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674775    2549 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674779    2549 flags.go:64] FLAG: --help="false"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674782    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674785    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674788    2549 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674791    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674794    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674798    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674800    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674803    2549 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674806    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674809    2549 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674812    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674815    2549 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674817    2549 flags.go:64] FLAG: --kube-reserved=""
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674821    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 19:30:46.681243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674824    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674827    2549 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674829    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674832    2549 flags.go:64] FLAG: --lock-file=""
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674835    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674838    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674841    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674848    2549 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674851    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674854    2549 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674856    2549 flags.go:64] FLAG: --logging-format="text"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674859    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674862    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674865    2549 flags.go:64] FLAG: --manifest-url=""
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674868    2549 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674872    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674875    2549 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674879    2549 flags.go:64] FLAG: --max-pods="110"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674882    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674886    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674888    2549 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674891    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674894    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674897    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674900    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 19:30:46.681889 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674907    2549 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674910    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674913    2549 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674916    2549 flags.go:64] FLAG: --pod-cidr=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674919    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674924    2549 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674927    2549 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674930    2549 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674933    2549 flags.go:64] FLAG: --port="10250"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674937    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674939    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e07a2033946a56d"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674942    2549 flags.go:64] FLAG: --qos-reserved=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674945    2549 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674948    2549 flags.go:64] FLAG: --register-node="true"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674951    2549 flags.go:64] FLAG: --register-with-taints=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674962    2549 flags.go:64] FLAG: --registry-burst="10"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674965    2549 flags.go:64] FLAG: --registry-qps="5"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674968    2549 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674970    2549 flags.go:64] FLAG: --reserved-memory=""
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674974    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674981    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674984    2549 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674987    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674990    2549 flags.go:64] FLAG: --runonce="false"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674993    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 19:30:46.682499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674996    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.674999    2549 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675002    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675005    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675008    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675011    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675014    2549 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675017    2549 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675019    2549 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675022    2549 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675025    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675028    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675031    2549 flags.go:64] FLAG: --system-cgroups=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675033    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675039    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675042    2549 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675045    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675049    2549 flags.go:64] FLAG: --tls-min-version=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675052    2549 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675055    2549 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675058    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675061    2549 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675065    2549 flags.go:64] FLAG: --v="2"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675069    2549 flags.go:64] FLAG: --version="false"
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675073    2549 flags.go:64] FLAG: --vmodule=""
Jun 03 19:30:46.683131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675076    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675080    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675209    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675213    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675216    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675219    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675222    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675225    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675227    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675230    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675233    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675236    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675238    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675241    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675243    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675246    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675249    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675251    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675255    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675259    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.683745 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675262    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675265    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675268    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675271    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675273    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675276    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675278    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675281    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675283    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675287    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675290    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675293    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675295    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675298    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675302    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675304    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675307    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675310    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675312    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.684377 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675315    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675317    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675320    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675322    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675325    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675327    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675330    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675332    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675335    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675337    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675340    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675342    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675345    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675348    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675351    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675353    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675356    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675359    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675362    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.684903 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675364    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675368    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675371    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675376    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675379    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675382    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675384    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675387    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675391    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675394    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675396    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675399    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675401    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675404    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675406    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675409    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675412    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675414    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675417    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675419    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.685371 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675422    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675424    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675427    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675429    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675432    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675434    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675437    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675440    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675442    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675444    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675447    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675450    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675452    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675455    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675457    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675461    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675465    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675468    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675471    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.685901 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675474    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675477    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.675480    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.675990    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.682938    2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.682952    2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.683888    2549 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.683896    2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683960    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683965    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683968    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683971    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683974    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683978    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683981    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.686394 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683984    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683987    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683989    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683993    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.683997    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684001    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684005    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684008    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684010    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684013    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684016    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684019    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684021    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684024    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684026    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684029    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684031    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684034    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684036    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.686799 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684039    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684041    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684044    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684053    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684056    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684059    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684062    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684064    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684067    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684070    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684073    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684075    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684078    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684081    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684083    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684086    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684089    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684091    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684094    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684096    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.687266 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684099    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684102    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684104    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684107    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684109    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684112    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684114    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684117    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684120    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684122    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684125    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684128    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684130    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684133    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684136    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684139    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684148    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684151    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684153    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684156    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.687750 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684159    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684161    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684164    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684166    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684169    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684172    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684174    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684177    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684179    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684182    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684185    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684187    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684190    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684192    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684195    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684198    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684200    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684203    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684206    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684208    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.688304 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684211    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684215    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684218    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684221    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684224    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684227    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684230    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684233    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684236    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684244    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684247    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684249    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.684254    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684404    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:30:46.688802 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684409    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684412    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684414    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684417    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684421    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684425    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684428    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684431    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684434    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684436    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684439    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684442    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684444    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684447    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684449    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684452    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684455    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684457    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684460    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684462    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:30:46.689144 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684465    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684467    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684470    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684472    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684476    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684478    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684481    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684484    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684492    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684495    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684497    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684500    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684502    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684505    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684508    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684510    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684513    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684515    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684518    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684520    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:30:46.689665 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684523    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684525    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684529    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684533    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684535    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684538    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684540    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684543    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684545    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684548    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684551    2549 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684553    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684556    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684558    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684561    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684563    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684566    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684569    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684571    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684574    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:30:46.690169 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684576    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684584    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684587    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684589    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684592    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684595    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684597    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684600    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684604    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684607    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684610    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684612    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684615    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684618    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684621    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684624    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684626    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684629    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684631    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:30:46.690647 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684634    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684636    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684639    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684642    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684644    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684647    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684649    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684651    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684654    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684657    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684659    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684662    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684664    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684667    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684669    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684678    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684680    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:30:46.691125 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:46.684683    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.684687    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.684819    2549 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.686923    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.688304    2549 server.go:1019] "Starting client certificate rotation"
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.688418    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.688488    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 19:30:46.691605 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.691227    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 19:30:46.696958 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.696937    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 19:30:46.708854 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.708835    2549 log.go:25] "Validated CRI v1 runtime API"
Jun 03 19:30:46.713149 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.713126    2549 log.go:25] "Validated CRI v1 image API"
Jun 03 19:30:46.714746 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.714731    2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 19:30:46.717158 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.717139    2549 fs.go:135] Filesystem UUIDs: map[5d48fa3d-060f-4239-b111-10da3da96347:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 824906d2-0ed9-4926-9269-57be86c3c5c8:/dev/nvme0n1p4]
Jun 03 19:30:46.717227 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.717157    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 19:30:46.721135 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.721117    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 19:30:46.722776 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.722652    2549 manager.go:216] Machine: {Timestamp:2026-06-03 19:30:46.721283697 +0000 UTC m=+0.340769923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098770 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c848097e0d6630a4e45f83db524b8 SystemUUID:ec2c8480-97e0-d663-0a4e-45f83db524b8 BootID:68f30704-a893-4f7e-8048-9a2bf86a7d2d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:da:48:5b:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:da:48:5b:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:12:c8:94:00:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 19:30:46.722776 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.722774    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 19:30:46.722890 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.722855    2549 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 19:30:46.726252 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.726221    2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 19:30:46.726432 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.726256    2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 19:30:46.727011 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.726997    2549 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 19:30:46.727069 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.727015    2549 container_manager_linux.go:309] "Creating device plugin manager"
Jun 03 19:30:46.727069 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.727025    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 19:30:46.727740 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.727728    2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 19:30:46.728935 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.728922    2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 03 19:30:46.731793 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.731779    2549 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 19:30:46.732104 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732091    2549 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 03 19:30:46.732175 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732150    2549 kubelet.go:486] "Attempting to sync node with API server"
Jun 03 19:30:46.732175 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732174    2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 19:30:46.732269 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732194    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 19:30:46.732269 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732208    2549 kubelet.go:398] "Adding apiserver pod source"
Jun 03 19:30:46.732269 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732221    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 19:30:46.732643 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732622    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 19:30:46.732643 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.732646    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 19:30:46.735806 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.735790    2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 03 19:30:46.740142 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.740124    2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 19:30:46.740235 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.740155    2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 03 19:30:46.741251 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741239    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741255    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741262    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741268    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741276    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741282    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741290    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741295    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 19:30:46.741300 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741302    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 19:30:46.741567 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741308    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 19:30:46.741567 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741316    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 19:30:46.741567 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741321    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 19:30:46.741962 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741950    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 19:30:46.741962 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.741961    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 19:30:46.745141 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.745128    2549 server.go:1268] "Started kubelet"
Jun 03 19:30:46.745255 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.745226    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 19:30:46.745408 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.745377    2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 19:30:46.745476 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.745429    2549 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 03 19:30:46.746090 ip-10-0-128-21 systemd[1]: Started Kubernetes Kubelet.
Jun 03 19:30:46.747276 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.747206    2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 19:30:46.747345 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.747332    2549 server.go:310] "Adding debug handlers to kubelet server"
Jun 03 19:30:46.747908 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.747886    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 19:30:46.747908 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.747891    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 19:30:46.748902 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.748886    2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 19:30:46.751104 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.750321    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-21.ec2.internal.18b5a9005e7ad866  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-21.ec2.internal,UID:ip-10-0-128-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-21.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.745102438 +0000 UTC m=+0.364588665,LastTimestamp:2026-06-03 19:30:46.745102438 +0000 UTC m=+0.364588665,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-21.ec2.internal,}"
Jun 03 19:30:46.752751 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.752734    2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 19:30:46.754002 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.753988    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 19:30:46.754079 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754000    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 19:30:46.754131 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.754086    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:46.754635 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754614    2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 03 19:30:46.754635 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754617    2549 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 03 19:30:46.754817 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754640    2549 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 03 19:30:46.754817 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754801    2549 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 19:30:46.754817 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.754811    2549 reconciler.go:29] "Reconciler: start to sync state"
Jun 03 19:30:46.755166 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.755146    2549 factory.go:55] Registering systemd factory
Jun 03 19:30:46.755166 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.755168    2549 factory.go:223] Registration of the systemd container factory successfully
Jun 03 19:30:46.756448 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.756415    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 19:30:46.756529 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756459    2549 factory.go:153] Registering CRI-O factory
Jun 03 19:30:46.756529 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756476    2549 factory.go:223] Registration of the crio container factory successfully
Jun 03 19:30:46.756529 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756524    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 19:30:46.756673 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.756530    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 19:30:46.756673 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756547    2549 factory.go:103] Registering Raw factory
Jun 03 19:30:46.756673 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756560    2549 manager.go:1196] Started watching for new ooms in manager
Jun 03 19:30:46.756971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.756955    2549 manager.go:349] Starting recovery of all containers
Jun 03 19:30:46.765661 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.765376    2549 manager.go:354] Recovery completed
Jun 03 19:30:46.771370 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.771355    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.776261 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776240    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.776343 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776273    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.776343 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776283    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.776794 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776777    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 19:30:46.776854 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776794    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 19:30:46.776854 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776781    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.776854 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.776814    2549 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 19:30:46.777490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.777477    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.777547 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.777511    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.777547 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.777523    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.778009 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.777997    2549 policy_none.go:49] "None policy: Start"
Jun 03 19:30:46.778048 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.778013    2549 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 03 19:30:46.778048 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.778027    2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 03 19:30:46.778344 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.778278    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-21.ec2.internal.18b5a90060563f8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-21.ec2.internal,UID:ip-10-0-128-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-21.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.776258443 +0000 UTC m=+0.395744669,LastTimestamp:2026-06-03 19:30:46.776258443 +0000 UTC m=+0.395744669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-21.ec2.internal,}"
Jun 03 19:30:46.779008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.778995    2549 policy_none.go:47] "Start"
Jun 03 19:30:46.788992 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.788925    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-21.ec2.internal.18b5a90060568b14  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-21.ec2.internal,UID:ip-10-0-128-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-21.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-21.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.77627778 +0000 UTC m=+0.395764006,LastTimestamp:2026-06-03 19:30:46.77627778 +0000 UTC m=+0.395764006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-21.ec2.internal,}"
Jun 03 19:30:46.799745 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.799682    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-21.ec2.internal.18b5a9006056ae82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-21.ec2.internal,UID:ip-10-0-128-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-21.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-21.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.77628685 +0000 UTC m=+0.395773077,LastTimestamp:2026-06-03 19:30:46.77628685 +0000 UTC m=+0.395773077,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-21.ec2.internal,}"
Jun 03 19:30:46.802873 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.802856    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxjxs"
Jun 03 19:30:46.808445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.808428    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxjxs"
Jun 03 19:30:46.808813 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.808698    2549 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-21.ec2.internal.18b5a90060563f8b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-21.ec2.internal.18b5a90060563f8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-21.ec2.internal,UID:ip-10-0-128-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-21.ec2.internal,},FirstTimestamp:2026-06-03 19:30:46.776258443 +0000 UTC m=+0.395744669,LastTimestamp:2026-06-03 19:30:46.777489787 +0000 UTC m=+0.396976013,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-21.ec2.internal,}"
Jun 03 19:30:46.812496 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.812482    2549 manager.go:337] "Starting Device Plugin manager"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.812511    2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.812524    2549 server.go:87] "Starting device plugin registration server"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.812801    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.812812    2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.812963    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.813113    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.813122    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.813658    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.813700    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.823115    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.824243    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.824279    2549 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.824298    2549 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.824331    2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 19:30:46.828097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.826408    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:46.913113 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.913087    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.914243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.914224    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.914344 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.914260    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.914344 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.914276    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.914344 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.914306    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.922082 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.922031    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.922082 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.922054    2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-21.ec2.internal\": node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:46.924953 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.924936    2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"]
Jun 03 19:30:46.925009 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.925000    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.925830 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.925812    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.925936 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.925842    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.925936 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.925851    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.927068 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927057    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.927187 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927170    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.927246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927208    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.927807 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927791    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.927807 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927800    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.927914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927821    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.927914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927820    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.927914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927843    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.927914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.927832    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.929487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.929473    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.929565 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.929496    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:30:46.930128 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.930113    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:30:46.930185 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.930143    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:30:46.930185 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:46.930154    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:30:46.941771 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.941742    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:46.954489 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.954466    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-21.ec2.internal\" not found" node="ip-10-0-128-21.ec2.internal"
Jun 03 19:30:46.958934 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:46.958917    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-21.ec2.internal\" not found" node="ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.042652 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.042620    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.055789 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.055748    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.055916 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.055800    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.055916 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.055822    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77e1a287528aa865925baabe12e40206-config\") pod \"kube-apiserver-proxy-ip-10-0-128-21.ec2.internal\" (UID: \"77e1a287528aa865925baabe12e40206\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.143085 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.143049    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.156366 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.156490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156385    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.156490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156400    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.156490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156409    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77e1a287528aa865925baabe12e40206-config\") pod \"kube-apiserver-proxy-ip-10-0-128-21.ec2.internal\" (UID: \"77e1a287528aa865925baabe12e40206\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.156490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156446    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77e1a287528aa865925baabe12e40206-config\") pod \"kube-apiserver-proxy-ip-10-0-128-21.ec2.internal\" (UID: \"77e1a287528aa865925baabe12e40206\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.156490 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.156463    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bfb01728237230ccbd8417348018e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal\" (UID: \"5f7bfb01728237230ccbd8417348018e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.243894 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.243811    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.257167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.257145    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.262634 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.262619    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.344311 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.344277    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.444865 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.444840    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.545360 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.545278    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.645904 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.645874    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-21.ec2.internal\" not found"
Jun 03 19:30:47.676771 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.676734    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:47.687623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.687602    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 19:30:47.687746 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.687728    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 19:30:47.687816 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.687776    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 19:30:47.724806 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:47.724753    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7bfb01728237230ccbd8417348018e.slice/crio-8680930e16b67c0b394b4bc55a781539d069a7db4d53701b4b719177569c5b76 WatchSource:0}: Error finding container 8680930e16b67c0b394b4bc55a781539d069a7db4d53701b4b719177569c5b76: Status 404 returned error can't find the container with id 8680930e16b67c0b394b4bc55a781539d069a7db4d53701b4b719177569c5b76
Jun 03 19:30:47.725351 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:47.725335    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e1a287528aa865925baabe12e40206.slice/crio-462ae92b7cf25b5ce274c35b79e2abab76a2fe08b5e2ca5ef1bdedcceb61ad28 WatchSource:0}: Error finding container 462ae92b7cf25b5ce274c35b79e2abab76a2fe08b5e2ca5ef1bdedcceb61ad28: Status 404 returned error can't find the container with id 462ae92b7cf25b5ce274c35b79e2abab76a2fe08b5e2ca5ef1bdedcceb61ad28
Jun 03 19:30:47.730074 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.730059    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:30:47.733175 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.733160    2549 apiserver.go:52] "Watching apiserver"
Jun 03 19:30:47.749613 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.749584    2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 19:30:47.750681 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.750660    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-r8dnw","openshift-multus/multus-additional-cni-plugins-d96mp","openshift-multus/network-metrics-daemon-nc4kc","kube-system/global-pull-secret-syncer-lzbk7","openshift-dns/node-resolver-hc2sd","openshift-multus/multus-fgtfn","openshift-network-diagnostics/network-check-target-ssts6","openshift-network-operator/iptables-alerter-pzwph","openshift-ovn-kubernetes/ovnkube-node-m9gnk","kube-system/konnectivity-agent-dx8m9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r","openshift-cluster-node-tuning-operator/tuned-4t5hw"]
Jun 03 19:30:47.752700 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.752683    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.753685 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.753664    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.753776 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.753739    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:47.754682 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.754668    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.754748 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.754709    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 19:30:47.754908 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.754846    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.755314 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755286    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.755411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755346    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 19:30:47.755411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755360    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 19:30:47.755411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755359    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.755411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755413    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8dvl\""
Jun 03 19:30:47.755667 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.755594    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 19:30:47.756264 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.756247    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.756796 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.756779    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.756887 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.756875    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 19:30:47.757055 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.757035    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.757125 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.757057    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j9qqb\""
Jun 03 19:30:47.757420 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.757407    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.757489 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.757467    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:47.758313 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.758298    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 19:30:47.758499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.758473    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.758593 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.758575    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mwj7b\""
Jun 03 19:30:47.758672 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.758658    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.758846 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.758831    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.759364 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759253    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-cnibin\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759364 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759282    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-os-release\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759364 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759311    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759364 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759334    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvv8b\" (UniqueName: \"kubernetes.io/projected/da6adb52-fab5-4808-a01d-18082a3b1b98-kube-api-access-fvv8b\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759372    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-system-cni-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759422    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.759553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759467    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-iptables-alerter-script\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.759553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759508    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-host-slash\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.759553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759536    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9928cd71-078a-4579-87af-e1868957cf2f-serviceca\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759572    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzll\" (UniqueName: \"kubernetes.io/projected/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-kube-api-access-xpzll\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759602    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759625    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgl47\" (UniqueName: \"kubernetes.io/projected/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-kube-api-access-mgl47\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759647    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9928cd71-078a-4579-87af-e1868957cf2f-host\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759669    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbgxt\" (UniqueName: \"kubernetes.io/projected/9928cd71-078a-4579-87af-e1868957cf2f-kube-api-access-tbgxt\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759694    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-binary-copy\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.759815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.759717    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.760165 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.760144    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.760713 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.760699    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.760777 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.760736    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h95s7\""
Jun 03 19:30:47.760897 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.760885    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.761261 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.761247    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:47.761329 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.761312    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:47.762197 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.762171    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tzxpq\""
Jun 03 19:30:47.762303 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.762288    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 19:30:47.762551 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.762535    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.763965 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.763949    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.764387 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764374    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 19:30:47.764444 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764412    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7tgkh\""
Jun 03 19:30:47.764542 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764529    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 19:30:47.764745 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764722    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.764852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764820    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 19:30:47.764951 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.764903    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.765073 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.765060    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 19:30:47.765125 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.765108    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"
Jun 03 19:30:47.765311 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.765294    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.765515 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.765290    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 19:30:47.766273 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.766257    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8tcvl\""
Jun 03 19:30:47.766472 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.766454    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 19:30:47.766718 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.766700    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal"]
Jun 03 19:30:47.766796 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.766755    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 19:30:47.766796 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.766781    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.767606 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.767591    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.767682 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.767656    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cdlvp\""
Jun 03 19:30:47.767834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.767818    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 19:30:47.767886 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.767825    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 19:30:47.767932 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.767891    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.769744 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.769723    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 19:30:47.769844 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.769779    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:30:47.769895 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.769875    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lpfkx\""
Jun 03 19:30:47.776196 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.776184    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 19:30:47.776381 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.776365    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal"]
Jun 03 19:30:47.786586 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.786572    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnn7r"
Jun 03 19:30:47.794232 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.794217    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnn7r"
Jun 03 19:30:47.811469 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.811432    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:25:46 +0000 UTC" deadline="2027-12-14 18:17:17.561561407 +0000 UTC"
Jun 03 19:30:47.811535 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.811470    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13414h46m29.750095644s"
Jun 03 19:30:47.828900 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.828852    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal" event={"ID":"77e1a287528aa865925baabe12e40206","Type":"ContainerStarted","Data":"462ae92b7cf25b5ce274c35b79e2abab76a2fe08b5e2ca5ef1bdedcceb61ad28"}
Jun 03 19:30:47.829805 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.829786    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal" event={"ID":"5f7bfb01728237230ccbd8417348018e","Type":"ContainerStarted","Data":"8680930e16b67c0b394b4bc55a781539d069a7db4d53701b4b719177569c5b76"}
Jun 03 19:30:47.856344 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.856321    2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 03 19:30:47.860811 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860792    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-kubelet\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.860875 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860821    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.860875 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860845    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.860943 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860873    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-socket-dir-parent\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.860943 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860896    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-daemon-config\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.860943 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860919    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-log-socket\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861044 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860944    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861044 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.860985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cnibin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.861044 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861014    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-k8s-cni-cncf-io\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.861044 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861038    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-etc-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861176 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861058    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-device-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.861176 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861080    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysconfig\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.861176 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861101    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-run\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.861176 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861127    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-system-cni-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861176 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861152    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-iptables-alerter-script\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861177    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-host-slash\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861200    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9928cd71-078a-4579-87af-e1868957cf2f-serviceca\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-hostroot\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861233    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-netns\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861236    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-host-slash\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861249    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-socket-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861300    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861322    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-os-release\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.861353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861347    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861363    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9928cd71-078a-4579-87af-e1868957cf2f-host\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861356    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-system-cni-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861396    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbgxt\" (UniqueName: \"kubernetes.io/projected/9928cd71-078a-4579-87af-e1868957cf2f-kube-api-access-tbgxt\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861424    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9928cd71-078a-4579-87af-e1868957cf2f-host\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861431    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-systemd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861457    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861457    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861506    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-script-lib\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861538    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861541    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-kubernetes\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861590    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-var-lib-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861619    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-netd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861645    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dttf4\" (UniqueName: \"kubernetes.io/projected/2c7fed49-86de-423a-b51c-f30d6576e27e-kube-api-access-dttf4\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861672    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-cnibin\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861679    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9928cd71-078a-4579-87af-e1868957cf2f-serviceca\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861700    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-iptables-alerter-script\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.861750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861710    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-os-release\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861741    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-netns\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861780    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-cnibin\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861793    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da6adb52-fab5-4808-a01d-18082a3b1b98-os-release\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861797    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-multus-certs\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861833    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861859    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-sys-fs\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861892    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-sys\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861917    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-var-lib-kubelet\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861942    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861966    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-multus\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.861988    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-env-overrides\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862012    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-kubelet-config\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.862046    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862045    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7fed49-86de-423a-b51c-f30d6576e27e-hosts-file\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.862104    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:48.362089938 +0000 UTC m=+1.981576165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:47.862424 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862122    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7fed49-86de-423a-b51c-f30d6576e27e-tmp-dir\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862140    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862153    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-systemd-units\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862171    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-binary-copy\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-conf-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862215    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862222    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862268    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-registration-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862327    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-modprobe-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862355    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-host\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvv8b\" (UniqueName: \"kubernetes.io/projected/da6adb52-fab5-4808-a01d-18082a3b1b98-kube-api-access-fvv8b\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862450    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cni-binary-copy\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862475    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-etc-kubernetes\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862489    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsch9\" (UniqueName: \"kubernetes.io/projected/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-kube-api-access-rsch9\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-ovn\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862516    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88vd\" (UniqueName: \"kubernetes.io/projected/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-kube-api-access-r88vd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862551    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-system-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862576    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-slash\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862594    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-bin\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovn-node-metrics-cert\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862671    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-lib-modules\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862691    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da6adb52-fab5-4808-a01d-18082a3b1b98-cni-binary-copy\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862707    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzll\" (UniqueName: \"kubernetes.io/projected/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-kube-api-access-xpzll\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862739    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgl47\" (UniqueName: \"kubernetes.io/projected/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-kube-api-access-mgl47\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862878    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-config\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862906    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c176592-725d-4ade-9fcd-e765d0eb40fe-agent-certs\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862932    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862959    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx4hb\" (UniqueName: \"kubernetes.io/projected/979acffb-cc1d-40ea-b3c0-d5af6edc4706-kube-api-access-nx4hb\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.862997    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv6kl\" (UniqueName: \"kubernetes.io/projected/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kube-api-access-hv6kl\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863028    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-dbus\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863054    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-conf\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-systemd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863522 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863089    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-tmp\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863108    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-kubelet\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863134    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863152    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-tuned\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863165    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-node-log\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863203    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863217    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c176592-725d-4ade-9fcd-e765d0eb40fe-konnectivity-ca\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.863972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.863233    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-bin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.868202 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.868169    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 19:30:47.871355 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.871332    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvv8b\" (UniqueName: \"kubernetes.io/projected/da6adb52-fab5-4808-a01d-18082a3b1b98-kube-api-access-fvv8b\") pod \"multus-additional-cni-plugins-d96mp\" (UID: \"da6adb52-fab5-4808-a01d-18082a3b1b98\") " pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:47.871447 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.871364    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzll\" (UniqueName: \"kubernetes.io/projected/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-kube-api-access-xpzll\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:47.871493 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.871475    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbgxt\" (UniqueName: \"kubernetes.io/projected/9928cd71-078a-4579-87af-e1868957cf2f-kube-api-access-tbgxt\") pod \"node-ca-r8dnw\" (UID: \"9928cd71-078a-4579-87af-e1868957cf2f\") " pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:47.871656 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.871642    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgl47\" (UniqueName: \"kubernetes.io/projected/9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5-kube-api-access-mgl47\") pod \"iptables-alerter-pzwph\" (UID: \"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5\") " pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:47.925913 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.925884    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:47.964497 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964468    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-hostroot\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.964497 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964497    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-netns\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964514    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-socket-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964534    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964550    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-os-release\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964568    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-systemd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964579    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-hostroot\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964591    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964583    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-netns\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964612    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-script-lib\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964625    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-systemd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964634    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-kubernetes\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964658    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-var-lib-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964669    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964685    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-netd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964688    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-socket-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964713    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dttf4\" (UniqueName: \"kubernetes.io/projected/2c7fed49-86de-423a-b51c-f30d6576e27e-kube-api-access-dttf4\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.964716    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964715    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-os-release\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.964732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964736    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-netns\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964739    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-var-lib-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964742    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-netd\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964751    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-kubernetes\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964779    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-multus-certs\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.964802    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:30:48.4647813 +0000 UTC m=+2.084267516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964803    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-netns\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964817    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-multus-certs\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964883    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-sys-fs\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964906    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-sys\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964928    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-var-lib-kubelet\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964954    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-sys-fs\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964965    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-multus\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964989    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-env-overrides\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964996    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965002    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-var-lib-kubelet\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.965583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.964994    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-sys\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965012    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-kubelet-config\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965035    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7fed49-86de-423a-b51c-f30d6576e27e-hosts-file\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965040    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-multus\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965057    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7fed49-86de-423a-b51c-f30d6576e27e-tmp-dir\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965083    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965097    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7fed49-86de-423a-b51c-f30d6576e27e-hosts-file\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965106    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-systemd-units\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965131    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-conf-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965145    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-systemd-units\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965045    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-kubelet-config\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965160    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965156    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965185    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-registration-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965189    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-conf-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965220    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-registration-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965290    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-modprobe-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965297    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-script-lib\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.966405 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965316    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-host\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965319    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7fed49-86de-423a-b51c-f30d6576e27e-tmp-dir\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965375    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cni-binary-copy\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965380    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-host\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965388    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-env-overrides\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965396    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-etc-kubernetes\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965412    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-modprobe-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965415    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-etc-kubernetes\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965435    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsch9\" (UniqueName: \"kubernetes.io/projected/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-kube-api-access-rsch9\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965454    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-ovn\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965472    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r88vd\" (UniqueName: \"kubernetes.io/projected/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-kube-api-access-r88vd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965489    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-system-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965517    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-run-ovn\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965548    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-system-cni-dir\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965585    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-slash\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-slash\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965635    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-bin\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965651    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovn-node-metrics-cert\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.967253 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965669    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-lib-modules\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965689    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-config\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965703    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c176592-725d-4ade-9fcd-e765d0eb40fe-agent-certs\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965721    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965701    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-cni-bin\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965744    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4hb\" (UniqueName: \"kubernetes.io/projected/979acffb-cc1d-40ea-b3c0-d5af6edc4706-kube-api-access-nx4hb\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965784    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv6kl\" (UniqueName: \"kubernetes.io/projected/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kube-api-access-hv6kl\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965793    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965808    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-dbus\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965820    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-lib-modules\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965831    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-conf\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965853    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-systemd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965874    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-tmp\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965896    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-kubelet\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965905    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cni-binary-copy\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965921    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965943    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-tuned\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-node-log\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965971    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-systemd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965981    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-kubelet\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.965994    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966017    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c176592-725d-4ade-9fcd-e765d0eb40fe-konnectivity-ca\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966036    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-bin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966065    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-kubelet\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966085    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11cad0a4-1bad-4f59-a486-66fa414c782b-dbus\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966110    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-kubelet\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966114    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-conf\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966132    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966151    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovnkube-config\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966171    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-node-log\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966202    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966213    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966216    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-var-lib-cni-bin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966229    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-socket-dir-parent\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966280    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-daemon-config\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.968623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966301    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-log-socket\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966310    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysctl-d\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966324    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cnibin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966348    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-k8s-cni-cncf-io\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966373    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-etc-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966396    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-device-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966419    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysconfig\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966440    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-run\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966475    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-host-run-k8s-cni-cncf-io\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966519    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-log-socket\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966534    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-run\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966567    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-cnibin\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966576    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/979acffb-cc1d-40ea-b3c0-d5af6edc4706-etc-openvswitch\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-socket-dir-parent\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966621    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-device-dir\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966621    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c176592-725d-4ade-9fcd-e765d0eb40fe-konnectivity-ca\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966660    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-sysconfig\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.966728    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-multus-daemon-config\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.969120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.968414    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-tmp\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.969654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.968523    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/979acffb-cc1d-40ea-b3c0-d5af6edc4706-ovn-node-metrics-cert\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:47.969654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.968546    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c176592-725d-4ade-9fcd-e765d0eb40fe-agent-certs\") pod \"konnectivity-agent-dx8m9\" (UID: \"7c176592-725d-4ade-9fcd-e765d0eb40fe\") " pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:47.969654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.969557    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-etc-tuned\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.972985 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.972968    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:30:47.972985 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.972987    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:30:47.973087 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.972998    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:47.973087 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:47.973047    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:48.473035396 +0000 UTC m=+2.092521609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:47.975282 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.975253    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dttf4\" (UniqueName: \"kubernetes.io/projected/2c7fed49-86de-423a-b51c-f30d6576e27e-kube-api-access-dttf4\") pod \"node-resolver-hc2sd\" (UID: \"2c7fed49-86de-423a-b51c-f30d6576e27e\") " pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:47.975660 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.975642    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsch9\" (UniqueName: \"kubernetes.io/projected/3edf1a0b-a2c6-4ec1-93c5-79584b1ec978-kube-api-access-rsch9\") pod \"multus-fgtfn\" (UID: \"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978\") " pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:47.975742 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.975682    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv6kl\" (UniqueName: \"kubernetes.io/projected/365a7dd7-6ab3-4a1e-9654-885fe29fd61d-kube-api-access-hv6kl\") pod \"aws-ebs-csi-driver-node-rwh4r\" (UID: \"365a7dd7-6ab3-4a1e-9654-885fe29fd61d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:47.975984 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.975968    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88vd\" (UniqueName: \"kubernetes.io/projected/9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1-kube-api-access-r88vd\") pod \"tuned-4t5hw\" (UID: \"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1\") " pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:47.976629 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:47.976614    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx4hb\" (UniqueName: \"kubernetes.io/projected/979acffb-cc1d-40ea-b3c0-d5af6edc4706-kube-api-access-nx4hb\") pod \"ovnkube-node-m9gnk\" (UID: \"979acffb-cc1d-40ea-b3c0-d5af6edc4706\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:48.062505 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.062423    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d96mp"
Jun 03 19:30:48.066283 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.066245    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:48.070118 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.070095    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pzwph"
Jun 03 19:30:48.071625 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.071602    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6adb52_fab5_4808_a01d_18082a3b1b98.slice/crio-7c88deb42935cff537acc38c64ddb589b9e9db184cdeca6b05f38a2048fbfa19 WatchSource:0}: Error finding container 7c88deb42935cff537acc38c64ddb589b9e9db184cdeca6b05f38a2048fbfa19: Status 404 returned error can't find the container with id 7c88deb42935cff537acc38c64ddb589b9e9db184cdeca6b05f38a2048fbfa19
Jun 03 19:30:48.077285 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.077262    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2ae459_2ddc_4a39_bae1_3f9c4b59c7a5.slice/crio-75d5723fc0912aae71741481589f4f5834d1254f0a1c19b1086e860186f5ccb7 WatchSource:0}: Error finding container 75d5723fc0912aae71741481589f4f5834d1254f0a1c19b1086e860186f5ccb7: Status 404 returned error can't find the container with id 75d5723fc0912aae71741481589f4f5834d1254f0a1c19b1086e860186f5ccb7
Jun 03 19:30:48.078096 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.078078    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8dnw"
Jun 03 19:30:48.082315 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.082294    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hc2sd"
Jun 03 19:30:48.085509 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.085484    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9928cd71_078a_4579_87af_e1868957cf2f.slice/crio-09ff6b6a0429135004111c177bea45f1e2f98bad815046c1026bcd594fee58e4 WatchSource:0}: Error finding container 09ff6b6a0429135004111c177bea45f1e2f98bad815046c1026bcd594fee58e4: Status 404 returned error can't find the container with id 09ff6b6a0429135004111c177bea45f1e2f98bad815046c1026bcd594fee58e4
Jun 03 19:30:48.087535 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.087518    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fgtfn"
Jun 03 19:30:48.089838 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.089811    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7fed49_86de_423a_b51c_f30d6576e27e.slice/crio-a89ad4fec13a3e449ebba4a38a6be310fb23a775255273cae92a24ba95be7578 WatchSource:0}: Error finding container a89ad4fec13a3e449ebba4a38a6be310fb23a775255273cae92a24ba95be7578: Status 404 returned error can't find the container with id a89ad4fec13a3e449ebba4a38a6be310fb23a775255273cae92a24ba95be7578
Jun 03 19:30:48.093017 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.092966    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:30:48.095306 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.095284    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edf1a0b_a2c6_4ec1_93c5_79584b1ec978.slice/crio-e6af912072711039b7411db3326ee6f59a17e2465f1434987a4faab7258c7d84 WatchSource:0}: Error finding container e6af912072711039b7411db3326ee6f59a17e2465f1434987a4faab7258c7d84: Status 404 returned error can't find the container with id e6af912072711039b7411db3326ee6f59a17e2465f1434987a4faab7258c7d84
Jun 03 19:30:48.098592 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.098573    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:30:48.103718 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.103392    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979acffb_cc1d_40ea_b3c0_d5af6edc4706.slice/crio-e9cbb3bdf9cebf0d346729ff4d03c8bae672b4ce1854625e86f11cc639585ade WatchSource:0}: Error finding container e9cbb3bdf9cebf0d346729ff4d03c8bae672b4ce1854625e86f11cc639585ade: Status 404 returned error can't find the container with id e9cbb3bdf9cebf0d346729ff4d03c8bae672b4ce1854625e86f11cc639585ade
Jun 03 19:30:48.103718 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.103489    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r"
Jun 03 19:30:48.107835 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.107569    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4t5hw"
Jun 03 19:30:48.111163 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.111140    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c176592_725d_4ade_9fcd_e765d0eb40fe.slice/crio-a4d74fdf4996b1276efb6c6b907de9164bd5b926c5f27c9a7798b41153ff1344 WatchSource:0}: Error finding container a4d74fdf4996b1276efb6c6b907de9164bd5b926c5f27c9a7798b41153ff1344: Status 404 returned error can't find the container with id a4d74fdf4996b1276efb6c6b907de9164bd5b926c5f27c9a7798b41153ff1344
Jun 03 19:30:48.116203 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.116183    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365a7dd7_6ab3_4a1e_9654_885fe29fd61d.slice/crio-4873024baf8ff595aa9a6244a892f63d5edc38c7280db044656a09f611f640ed WatchSource:0}: Error finding container 4873024baf8ff595aa9a6244a892f63d5edc38c7280db044656a09f611f640ed: Status 404 returned error can't find the container with id 4873024baf8ff595aa9a6244a892f63d5edc38c7280db044656a09f611f640ed
Jun 03 19:30:48.117510 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:30:48.117477    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4f8c4a_2ed8_41f5_a908_c4f9ae5878a1.slice/crio-88b13c9b9e4c43c15b2cb474fb678f3ba7f9f00caa0cc16d0360123deb6623ff WatchSource:0}: Error finding container 88b13c9b9e4c43c15b2cb474fb678f3ba7f9f00caa0cc16d0360123deb6623ff: Status 404 returned error can't find the container with id 88b13c9b9e4c43c15b2cb474fb678f3ba7f9f00caa0cc16d0360123deb6623ff
Jun 03 19:30:48.370673 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.370589    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:48.370860 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.370795    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:48.370860 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.370859    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.37083987 +0000 UTC m=+2.990326109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:48.471383 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.471337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:48.471551 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.471532    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:48.471623 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.471612    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.471582654 +0000 UTC m=+3.091068871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:48.572031 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.571995    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:48.572238 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.572219    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:30:48.572305 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.572240    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:30:48.572305 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.572253    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:48.572400 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:48.572312    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:49.572294495 +0000 UTC m=+3.191780710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:48.784620 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.784422    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:48.796698 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.796661    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:47 +0000 UTC" deadline="2027-12-16 11:37:49.931971934 +0000 UTC"
Jun 03 19:30:48.796698 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.796698    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13456h7m1.135278244s"
Jun 03 19:30:48.850366 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.850327    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerStarted","Data":"7c88deb42935cff537acc38c64ddb589b9e9db184cdeca6b05f38a2048fbfa19"}
Jun 03 19:30:48.866099 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.866027    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4t5hw" event={"ID":"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1","Type":"ContainerStarted","Data":"88b13c9b9e4c43c15b2cb474fb678f3ba7f9f00caa0cc16d0360123deb6623ff"}
Jun 03 19:30:48.869543 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.869445    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dx8m9" event={"ID":"7c176592-725d-4ade-9fcd-e765d0eb40fe","Type":"ContainerStarted","Data":"a4d74fdf4996b1276efb6c6b907de9164bd5b926c5f27c9a7798b41153ff1344"}
Jun 03 19:30:48.881715 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.881681    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"e9cbb3bdf9cebf0d346729ff4d03c8bae672b4ce1854625e86f11cc639585ade"}
Jun 03 19:30:48.896783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.894653    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fgtfn" event={"ID":"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978","Type":"ContainerStarted","Data":"e6af912072711039b7411db3326ee6f59a17e2465f1434987a4faab7258c7d84"}
Jun 03 19:30:48.917783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.913900    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hc2sd" event={"ID":"2c7fed49-86de-423a-b51c-f30d6576e27e","Type":"ContainerStarted","Data":"a89ad4fec13a3e449ebba4a38a6be310fb23a775255273cae92a24ba95be7578"}
Jun 03 19:30:48.934656 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.934620    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8dnw" event={"ID":"9928cd71-078a-4579-87af-e1868957cf2f","Type":"ContainerStarted","Data":"09ff6b6a0429135004111c177bea45f1e2f98bad815046c1026bcd594fee58e4"}
Jun 03 19:30:48.947285 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.947197    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r" event={"ID":"365a7dd7-6ab3-4a1e-9654-885fe29fd61d","Type":"ContainerStarted","Data":"4873024baf8ff595aa9a6244a892f63d5edc38c7280db044656a09f611f640ed"}
Jun 03 19:30:48.956357 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:48.956325    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pzwph" event={"ID":"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5","Type":"ContainerStarted","Data":"75d5723fc0912aae71741481589f4f5834d1254f0a1c19b1086e860186f5ccb7"}
Jun 03 19:30:49.379653 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.379614    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:49.379869 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.379850    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:49.379987 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.379939    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:51.379898206 +0000 UTC m=+4.999384441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:49.480460 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.480426    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:49.480685 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.480667    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:49.480821 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.480738    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:30:51.480717145 +0000 UTC m=+5.100203372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:49.581234 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.581195    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:49.581461 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.581443    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:30:49.581586 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.581471    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:30:49.581586 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.581484    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:49.581709 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.581586    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:51.581565233 +0000 UTC m=+5.201051461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:49.797732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.797638    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:25:47 +0000 UTC" deadline="2027-12-02 02:36:00.027745495 +0000 UTC"
Jun 03 19:30:49.797732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.797701    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13111h5m10.230048524s"
Jun 03 19:30:49.825296 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.825265    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:49.825479 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.825394    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:49.825852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.825821    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:49.825956 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.825918    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:49.826008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:49.825983    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:49.826079 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:49.826061    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:50.088184 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:50.088096    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:30:51.400785 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.400736    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:51.401230 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.400908    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:51.401230 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.400983    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:55.400961332 +0000 UTC m=+9.020447559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:51.501913 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.501873    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:51.502098 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.502030    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:51.502169 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.502102    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:30:55.502083093 +0000 UTC m=+9.121569309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:51.603363 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.603280    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:51.603549 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.603439    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:30:51.603549 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.603464    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:30:51.603549 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.603477    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:51.603549 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.603543    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:30:55.603523679 +0000 UTC m=+9.223009894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:51.825393 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.825361    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:51.825581 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.825521    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:51.826032 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.825901    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:51.826032 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.826000    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:51.826032 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:51.826001    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:51.826242 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:51.826104    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:53.825583 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:53.825496    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:53.826057 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:53.825642    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:53.826057 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:53.825720    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:53.826057 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:53.825838    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:53.826057 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:53.825881    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:53.826057 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:53.825950    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:55.434265 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.434222    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:55.434904 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.434400    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:55.434904 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.434476    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:03.434454549 +0000 UTC m=+17.053940762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:30:55.535333 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.535295    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:55.535494 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.535448    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:55.535551 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.535531    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:31:03.5355097 +0000 UTC m=+17.154995934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:30:55.635876 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.635828    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:55.636060 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.636006    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:30:55.636060 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.636028    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:30:55.636060 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.636041    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:55.636230 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.636101    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:31:03.636083207 +0000 UTC m=+17.255569432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:30:55.824815 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.824684    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:55.824968 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.824829    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:55.825195 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.825177    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:55.825292 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.825273    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:55.825367 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:55.825346    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:55.825450 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:55.825433    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:57.825287 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:57.825251    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:57.825781 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:57.825393    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:57.825781 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:57.825254    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:57.825781 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:57.825254    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:57.825781 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:57.825510    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:30:57.825781 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:57.825592    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:59.825298 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:59.825258    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:30:59.825794 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:59.825383    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:30:59.825794 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:59.825397    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:30:59.825794 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:30:59.825419    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:30:59.825794 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:59.825507    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:30:59.825794 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:30:59.825612    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:01.825416 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:01.825213    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:01.825883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:01.825234    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:01.825883 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:01.825496    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:01.825883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:01.825270    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:01.825883 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:01.825602    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:01.825883 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:01.825663    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:03.489951 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.489916    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:03.490401 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.490071    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:31:03.490401 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.490154    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:19.490130744 +0000 UTC m=+33.109616981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:31:03.590875 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.590744    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:03.591041 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.590932    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:31:03.591041 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.591012    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:31:19.590997152 +0000 UTC m=+33.210483372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:31:03.691656 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.691604    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:03.691845 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.691807    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:31:03.691845 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.691835    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:31:03.691985 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.691850    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:31:03.691985 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.691915    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:31:19.691896205 +0000 UTC m=+33.311382433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:31:03.825601 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.825453    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:03.825601 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.825482    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:03.825601 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:03.825492    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:03.825897 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.825649    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:03.825897 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.825601    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:03.825897 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:03.825747    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:05.824477 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:05.824435    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:05.824477 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:05.824459    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:05.824971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:05.824553    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:05.824971 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:05.824561    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:05.824971 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:05.824689    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:05.824971 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:05.824743    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:07.824601 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:07.824575    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:07.825397 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:07.824689    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:07.825397 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:07.825114    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:07.825397 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:07.825213    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:07.825397 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:07.825272    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:07.825397 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:07.825356    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:08.001356 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.001069    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal" event={"ID":"77e1a287528aa865925baabe12e40206","Type":"ContainerStarted","Data":"e2470b24f401f929e6ad83b3f3191751181ffdbc48ba5d905b2383b8ba2d899b"}
Jun 03 19:31:08.002523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.002497    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4t5hw" event={"ID":"9d4f8c4a-2ed8-41f5-a908-c4f9ae5878a1","Type":"ContainerStarted","Data":"2314a1da12c57aaf110246b1ed875a08fe641ea4a755f4be6b1f5b946d2cfdd6"}
Jun 03 19:31:08.004054 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.004005    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dx8m9" event={"ID":"7c176592-725d-4ade-9fcd-e765d0eb40fe","Type":"ContainerStarted","Data":"aa6c465ad3ec21b41d6eb13985eafc4085ec34db43eb349c5d4c99f63df2289f"}
Jun 03 19:31:08.006967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.006949    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:31:08.007323 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007302    2549 generic.go:356] "Generic (PLEG): container finished" podID="979acffb-cc1d-40ea-b3c0-d5af6edc4706" containerID="10bc4c12b49112e20bcbc535c7ea200db2b812f9338feb656f55b44a76af3c11" exitCode=1
Jun 03 19:31:08.007400 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007368    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"49225ffa7e54bffb7e90479492cd4b6c752c0fea3e97ca170bb9381f1be58b69"}
Jun 03 19:31:08.007449 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007442    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:31:08.007499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007457    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"a2b7397a6b7b267a79dcb05805f329c93378708a19385957753fadefed86fd5f"}
Jun 03 19:31:08.007544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007500    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"0fce381be47755e3f50f5b0de4437cd896f392214996b3df47dc904053e30b67"}
Jun 03 19:31:08.007590 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007544    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"238c190a40d4e593e0544cb4051f54a7c5ca2bef4b806dc20b209af1ca75b3a8"}
Jun 03 19:31:08.007694 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007593    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerDied","Data":"10bc4c12b49112e20bcbc535c7ea200db2b812f9338feb656f55b44a76af3c11"}
Jun 03 19:31:08.007694 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.007640    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"2d13ec2ff8654dcff242afbb56f11b889f358cd87acdbcef33ed94cc39f8a4fd"}
Jun 03 19:31:08.008069 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.008051    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:31:08.009167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.009146    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fgtfn" event={"ID":"3edf1a0b-a2c6-4ec1-93c5-79584b1ec978","Type":"ContainerStarted","Data":"63f1f255957ec2ca655f5beda37c13d704d8f5d484ff3a4455e438698f862a7c"}
Jun 03 19:31:08.015801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.015420    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hc2sd" event={"ID":"2c7fed49-86de-423a-b51c-f30d6576e27e","Type":"ContainerStarted","Data":"c571c597890cb3a7293553b5b721a0692250a359ddbac9ea5e06653e3a883f0e"}
Jun 03 19:31:08.016995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.016974    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8dnw" event={"ID":"9928cd71-078a-4579-87af-e1868957cf2f","Type":"ContainerStarted","Data":"53dbc6eaac27a1878243a314ee75c865d9b7387abfd07cab19345e65fa83cc69"}
Jun 03 19:31:08.018476 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.018450    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal" event={"ID":"5f7bfb01728237230ccbd8417348018e","Type":"ContainerStarted","Data":"626e2993730e67814d6061369d2d22e298f29f885410cb66e77aca9d9217ede5"}
Jun 03 19:31:08.019920 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.019901    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r" event={"ID":"365a7dd7-6ab3-4a1e-9654-885fe29fd61d","Type":"ContainerStarted","Data":"03205995db981e0a045a7bbc2f054cb73295ef018d3f5d16c1b80a92cb414dd6"}
Jun 03 19:31:08.021207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.021182    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerStarted","Data":"0eda86fa9298ad37668b4563a8570469e215e866b20a200ca05c9ecbce80f6a7"}
Jun 03 19:31:08.031546 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.031509    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-21.ec2.internal" podStartSLOduration=21.031496836 podStartE2EDuration="21.031496836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.013828377 +0000 UTC m=+21.633314612" watchObservedRunningTime="2026-06-03 19:31:08.031496836 +0000 UTC m=+21.650983070"
Jun 03 19:31:08.045687 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.045633    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fgtfn" podStartSLOduration=1.385318435 podStartE2EDuration="21.045611481s" totalImagesPullingTime="19.660293046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.031230234 +0000 UTC m=+21.650716470" watchObservedRunningTime="2026-06-03 19:31:08.045611481 +0000 UTC m=+21.665097717"
Jun 03 19:31:08.046242 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.046204    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dx8m9" podStartSLOduration=2.071112132 podStartE2EDuration="21.046187337s" totalImagesPullingTime="18.975075205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.045362937 +0000 UTC m=+21.664849173" watchObservedRunningTime="2026-06-03 19:31:08.046187337 +0000 UTC m=+21.665673574"
Jun 03 19:31:08.082695 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.082643    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4t5hw" podStartSLOduration=2.093075468 podStartE2EDuration="21.082622059s" totalImagesPullingTime="18.989546591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.066337736 +0000 UTC m=+21.685823971" watchObservedRunningTime="2026-06-03 19:31:08.082622059 +0000 UTC m=+21.702108295"
Jun 03 19:31:08.095116 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.095072    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r8dnw" podStartSLOduration=2.075651222 podStartE2EDuration="21.095056679s" totalImagesPullingTime="19.019405457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.094623101 +0000 UTC m=+21.714109335" watchObservedRunningTime="2026-06-03 19:31:08.095056679 +0000 UTC m=+21.714542973"
Jun 03 19:31:08.109282 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:08.109243    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hc2sd" podStartSLOduration=2.08806601 podStartE2EDuration="21.109227564s" totalImagesPullingTime="19.021161554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.108844569 +0000 UTC m=+21.728330803" watchObservedRunningTime="2026-06-03 19:31:08.109227564 +0000 UTC m=+21.728713799"
Jun 03 19:31:09.024567 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.024533    2549 generic.go:356] "Generic (PLEG): container finished" podID="5f7bfb01728237230ccbd8417348018e" containerID="626e2993730e67814d6061369d2d22e298f29f885410cb66e77aca9d9217ede5" exitCode=0
Jun 03 19:31:09.025105 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.024615    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal" event={"ID":"5f7bfb01728237230ccbd8417348018e","Type":"ContainerDied","Data":"626e2993730e67814d6061369d2d22e298f29f885410cb66e77aca9d9217ede5"}
Jun 03 19:31:09.025971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.025944    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pzwph" event={"ID":"9b2ae459-2ddc-4a39-bae1-3f9c4b59c7a5","Type":"ContainerStarted","Data":"259d925d059d174353f03cd554e40cf08bd666947f0051cc2e79555b56d563da"}
Jun 03 19:31:09.027257 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.027237    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="0eda86fa9298ad37668b4563a8570469e215e866b20a200ca05c9ecbce80f6a7" exitCode=0
Jun 03 19:31:09.027375 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.027308    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"0eda86fa9298ad37668b4563a8570469e215e866b20a200ca05c9ecbce80f6a7"}
Jun 03 19:31:09.082218 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.082155    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pzwph" podStartSLOduration=4.054218197 podStartE2EDuration="23.082133289s" totalImagesPullingTime="19.027915092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:09.081937958 +0000 UTC m=+22.701424193" watchObservedRunningTime="2026-06-03 19:31:09.082133289 +0000 UTC m=+22.701619526"
Jun 03 19:31:09.165345 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.165111    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 19:31:09.823777 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.823672    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:31:09.165127447Z","UUID":"d9f5705f-cd25-4ead-a399-e0fa6b0d4da4","Handler":null,"Name":"","Endpoint":""}
Jun 03 19:31:09.824530 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.824500    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:09.824654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.824500    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:09.824775 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.824504    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:09.824878 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:09.824778    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:09.824878 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:09.824636    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:09.824992 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:09.824891    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:09.825418 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.825399    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 19:31:09.825533 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:09.825440    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 19:31:10.032276 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:10.032243    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal" event={"ID":"5f7bfb01728237230ccbd8417348018e","Type":"ContainerStarted","Data":"2de15fea09385fa260720bc1cc155c6e17bbaad8153d261fec589f7cf87a90d1"}
Jun 03 19:31:10.034294 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:10.034268    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r" event={"ID":"365a7dd7-6ab3-4a1e-9654-885fe29fd61d","Type":"ContainerStarted","Data":"62d5d3801f07654b5c8dca44fcd9f6f6a46f5d7e8f1ef6a8a2d860f64baa481b"}
Jun 03 19:31:10.034475 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:10.034461    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 19:31:10.045678 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:10.045617    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-21.ec2.internal" podStartSLOduration=23.045599159 podStartE2EDuration="23.045599159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:10.045421922 +0000 UTC m=+23.664908158" watchObservedRunningTime="2026-06-03 19:31:10.045599159 +0000 UTC m=+23.665085397"
Jun 03 19:31:11.040418 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.040384    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:31:11.040848 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.040794    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"2502cf1b15331649d643b536838c18d1ce7e59695523f39314a7b2f4f461ccde"}
Jun 03 19:31:11.043907 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.043866    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r" event={"ID":"365a7dd7-6ab3-4a1e-9654-885fe29fd61d","Type":"ContainerStarted","Data":"7b8dc1decdaac2b674dbfb87e11486c948a704f9ad83e89255406d43acf00d32"}
Jun 03 19:31:11.061814 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.061751    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwh4r" podStartSLOduration=2.71313347 podStartE2EDuration="24.061733877s" totalImagesPullingTime="21.348600407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:11.061623746 +0000 UTC m=+24.681109982" watchObservedRunningTime="2026-06-03 19:31:11.061733877 +0000 UTC m=+24.681220113"
Jun 03 19:31:11.824849 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.824815    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:11.824849 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.824845    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:11.825060 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:11.824854    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:11.825060 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:11.824939    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:11.825060 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:11.825011    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:11.825193 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:11.825092    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:13.824729 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:13.824546    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:13.825585 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:13.824544    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:13.825585 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:13.824849    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:13.825585 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:13.824575    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:13.825585 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:13.824883    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:13.825585 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:13.824950    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:14.052372 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.052339    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="42e78ffcfab57634f422ab71e026c8932a177b0c4bcce345249cddecc4133341" exitCode=0
Jun 03 19:31:14.052570 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.052412    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"42e78ffcfab57634f422ab71e026c8932a177b0c4bcce345249cddecc4133341"}
Jun 03 19:31:14.055835 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.055812    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:31:14.056201 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.056175    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"f8c150a793fb6010735cc3804b243d4a4fdffb688bccc6abdf1b6b00a93a248b"}
Jun 03 19:31:14.056391 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.056379    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:14.056447 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.056416    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:14.056622 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.056606    2549 scope.go:117] "RemoveContainer" containerID="10bc4c12b49112e20bcbc535c7ea200db2b812f9338feb656f55b44a76af3c11"
Jun 03 19:31:14.072863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:14.072842    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:15.062722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.062562    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:31:15.063141 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.063115    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" event={"ID":"979acffb-cc1d-40ea-b3c0-d5af6edc4706","Type":"ContainerStarted","Data":"0d700c705feaa23f38c947cc304be79d7c8b735c1273828674440e2d99849321"}
Jun 03 19:31:15.063411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.063391    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:15.065386 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.065365    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerStarted","Data":"d0f0bf65f01678f768434cd6f46d12d2f4e34a8630afd90ec031081b0a9c36b2"}
Jun 03 19:31:15.078142 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.078116    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:15.091614 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.091576    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk" podStartSLOduration=9.063140272 podStartE2EDuration="28.091562565s" totalImagesPullingTime="19.028422293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:15.090367609 +0000 UTC m=+28.709853844" watchObservedRunningTime="2026-06-03 19:31:15.091562565 +0000 UTC m=+28.711048800"
Jun 03 19:31:15.135611 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.135580    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lzbk7"]
Jun 03 19:31:15.135746 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.135692    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:15.135815 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:15.135790    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:15.136151 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.136133    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssts6"]
Jun 03 19:31:15.136220 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.136211    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:15.136290 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:15.136275    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:15.137942 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.137918    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nc4kc"]
Jun 03 19:31:15.138053 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:15.137995    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:15.138101 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:15.138062    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:16.069317 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:16.069282    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="d0f0bf65f01678f768434cd6f46d12d2f4e34a8630afd90ec031081b0a9c36b2" exitCode=0
Jun 03 19:31:16.069711 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:16.069333    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"d0f0bf65f01678f768434cd6f46d12d2f4e34a8630afd90ec031081b0a9c36b2"}
Jun 03 19:31:16.828388 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:16.828216    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:16.828388 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:16.828334    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:16.828665 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:16.828615    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:16.829329 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:16.829163    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:16.829329 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:16.829278    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:16.829483 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:16.828741    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:17.300639 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:17.300601    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:31:17.301045 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:17.300773    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 19:31:17.301207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:17.301192    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dx8m9"
Jun 03 19:31:18.075750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:18.075565    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="c4cd0a986a260cefa13d9229478ae8d9b15bdce7fe6891c2128d7b3905e87dc2" exitCode=0
Jun 03 19:31:18.075948 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:18.075652    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"c4cd0a986a260cefa13d9229478ae8d9b15bdce7fe6891c2128d7b3905e87dc2"}
Jun 03 19:31:18.825433 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:18.825399    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:18.825911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:18.825399    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:18.825911 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:18.825540    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:31:18.825911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:18.825406    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:18.825911 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:18.825607    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lzbk7" podUID="11cad0a4-1bad-4f59-a486-66fa414c782b"
Jun 03 19:31:18.825911 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:18.825675    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssts6" podUID="fc040914-7cee-41ef-8a8d-7460f3cc201a"
Jun 03 19:31:19.508461 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.508377    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:19.508601 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.508528    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:31:19.508640 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.508600    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:51.508580406 +0000 UTC m=+65.128066667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:31:19.609097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.609062    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:19.609273 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.609179    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:31:19.609273 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.609261    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret podName:11cad0a4-1bad-4f59-a486-66fa414c782b nodeName:}" failed. No retries permitted until 2026-06-03 19:31:51.609243033 +0000 UTC m=+65.228729255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret") pod "global-pull-secret-syncer-lzbk7" (UID: "11cad0a4-1bad-4f59-a486-66fa414c782b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:31:19.690775 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.690720    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-21.ec2.internal" event="NodeReady"
Jun 03 19:31:19.690946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.690938    2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 03 19:31:19.709421 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.709382    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:19.709583 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.709553    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:31:19.709583 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.709572    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:31:19.709583 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.709583    2549 projected.go:196] Error preparing data for projected volume kube-api-access-7svcx for pod openshift-network-diagnostics/network-check-target-ssts6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:31:19.709712 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.709644    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx podName:fc040914-7cee-41ef-8a8d-7460f3cc201a nodeName:}" failed. No retries permitted until 2026-06-03 19:31:51.70963038 +0000 UTC m=+65.329116593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7svcx" (UniqueName: "kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx") pod "network-check-target-ssts6" (UID: "fc040914-7cee-41ef-8a8d-7460f3cc201a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:31:19.733113 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.733085    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-55gbb"]
Jun 03 19:31:19.735133 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.735094    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.736621 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.736598    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qhn2c"]
Jun 03 19:31:19.737395 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.737369    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 19:31:19.737395 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.737376    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\""
Jun 03 19:31:19.737561 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.737397    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 19:31:19.738661 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.738645    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.740709 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.740688    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 19:31:19.740829 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.740734    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gvlhb\""
Jun 03 19:31:19.740829 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.740740    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 19:31:19.740829 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.740736    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 19:31:19.744802 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.744442    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-55gbb"]
Jun 03 19:31:19.747875 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.747835    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhn2c"]
Jun 03 19:31:19.810386 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810314    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70377450-eb03-41eb-baf9-fe3cc22d8df8-tmp-dir\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.810386 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810345    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfvg\" (UniqueName: \"kubernetes.io/projected/70377450-eb03-41eb-baf9-fe3cc22d8df8-kube-api-access-qwfvg\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.810386 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810385    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvcm\" (UniqueName: \"kubernetes.io/projected/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-kube-api-access-xkvcm\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.810657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-cert\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.810657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810495    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70377450-eb03-41eb-baf9-fe3cc22d8df8-config-volume\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.810657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.810537    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.911649 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911612    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911683    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70377450-eb03-41eb-baf9-fe3cc22d8df8-tmp-dir\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911704    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfvg\" (UniqueName: \"kubernetes.io/projected/70377450-eb03-41eb-baf9-fe3cc22d8df8-kube-api-access-qwfvg\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911732    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvcm\" (UniqueName: \"kubernetes.io/projected/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-kube-api-access-xkvcm\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911748    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-cert\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.911790    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.911805    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70377450-eb03-41eb-baf9-fe3cc22d8df8-config-volume\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.912127 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:19.911863    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:20.411841055 +0000 UTC m=+34.031327269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:19.912430 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.912265    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70377450-eb03-41eb-baf9-fe3cc22d8df8-tmp-dir\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.912430 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.912351    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70377450-eb03-41eb-baf9-fe3cc22d8df8-config-volume\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.917047 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.917025    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-cert\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:19.920232 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.920211    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfvg\" (UniqueName: \"kubernetes.io/projected/70377450-eb03-41eb-baf9-fe3cc22d8df8-kube-api-access-qwfvg\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:19.920636 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:19.920616    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvcm\" (UniqueName: \"kubernetes.io/projected/d27be6a6-e7d6-4f39-833c-c2a3bb1de913-kube-api-access-xkvcm\") pod \"ingress-canary-qhn2c\" (UID: \"d27be6a6-e7d6-4f39-833c-c2a3bb1de913\") " pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:20.055665 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.055632    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhn2c"
Jun 03 19:31:20.203503 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.203463    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhn2c"]
Jun 03 19:31:20.208211 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:31:20.208178    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27be6a6_e7d6_4f39_833c_c2a3bb1de913.slice/crio-1b53b57475cc938fc5f1c4d6134eca0555015ad8cdc2a62f2fd61cc0c9c03e42 WatchSource:0}: Error finding container 1b53b57475cc938fc5f1c4d6134eca0555015ad8cdc2a62f2fd61cc0c9c03e42: Status 404 returned error can't find the container with id 1b53b57475cc938fc5f1c4d6134eca0555015ad8cdc2a62f2fd61cc0c9c03e42
Jun 03 19:31:20.415496 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.415466    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:20.415634 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:20.415568    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:20.415634 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:20.415621    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:21.415608217 +0000 UTC m=+35.035094430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:20.825083 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.824997    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:20.825252 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.824997    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:20.825252 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.825147    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:20.827909 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.827886    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 19:31:20.827909 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.827907    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 19:31:20.829783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.829327    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\""
Jun 03 19:31:20.829783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.829343    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 19:31:20.829783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.829432    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 19:31:20.829990 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:20.829829    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\""
Jun 03 19:31:21.085238 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:21.085153    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhn2c" event={"ID":"d27be6a6-e7d6-4f39-833c-c2a3bb1de913","Type":"ContainerStarted","Data":"1b53b57475cc938fc5f1c4d6134eca0555015ad8cdc2a62f2fd61cc0c9c03e42"}
Jun 03 19:31:21.423843 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:21.423631    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:21.424015 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:21.423799    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:21.424015 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:21.423980    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:23.423956932 +0000 UTC m=+37.043443158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:22.091606 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.091569    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerStarted","Data":"730658cd9ee12b7fbc11da6a237acdfdc798d8c01ad8b4b05e2beebdaa5b5ccb"}
Jun 03 19:31:22.125406 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.125377    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"]
Jun 03 19:31:22.127969 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.127950    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.130377 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130253    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 03 19:31:22.130377 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130342    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 03 19:31:22.130377 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130359    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 03 19:31:22.130377 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130370    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 03 19:31:22.130642 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130380    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 03 19:31:22.130726 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130711    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 03 19:31:22.130906 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.130886    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 03 19:31:22.139394 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.139328    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"]
Jun 03 19:31:22.230568 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230532    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.230753 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230643    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.230753 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.230899 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230775    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6206a864-54e6-4cee-8298-96d8268657ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.230899 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230835    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.230899 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.230885    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdch\" (UniqueName: \"kubernetes.io/projected/6206a864-54e6-4cee-8298-96d8268657ba-kube-api-access-lhdch\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.331652 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331614    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.331872 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331677    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.331872 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331713    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.331872 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331742    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6206a864-54e6-4cee-8298-96d8268657ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.331872 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331844    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.332082 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.331884    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdch\" (UniqueName: \"kubernetes.io/projected/6206a864-54e6-4cee-8298-96d8268657ba-kube-api-access-lhdch\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.332648 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.332592    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6206a864-54e6-4cee-8298-96d8268657ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.335594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.335568    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-ca\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.335712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.335629    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.335712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.335700    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.335839 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.335741    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6206a864-54e6-4cee-8298-96d8268657ba-hub\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.339609 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.339589    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdch\" (UniqueName: \"kubernetes.io/projected/6206a864-54e6-4cee-8298-96d8268657ba-kube-api-access-lhdch\") pod \"cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf\" (UID: \"6206a864-54e6-4cee-8298-96d8268657ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.462810 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.462770    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:31:22.607864 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:22.607827    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"]
Jun 03 19:31:23.058325 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:31:23.058291    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6206a864_54e6_4cee_8298_96d8268657ba.slice/crio-44d577c706db5f6575574a6b5a2b6cbb8bd89abb4141fbac43f188148a27ceab WatchSource:0}: Error finding container 44d577c706db5f6575574a6b5a2b6cbb8bd89abb4141fbac43f188148a27ceab: Status 404 returned error can't find the container with id 44d577c706db5f6575574a6b5a2b6cbb8bd89abb4141fbac43f188148a27ceab
Jun 03 19:31:23.095878 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:23.095824    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="730658cd9ee12b7fbc11da6a237acdfdc798d8c01ad8b4b05e2beebdaa5b5ccb" exitCode=0
Jun 03 19:31:23.096221 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:23.095908    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"730658cd9ee12b7fbc11da6a237acdfdc798d8c01ad8b4b05e2beebdaa5b5ccb"}
Jun 03 19:31:23.097008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:23.096985    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerStarted","Data":"44d577c706db5f6575574a6b5a2b6cbb8bd89abb4141fbac43f188148a27ceab"}
Jun 03 19:31:23.442026 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:23.441841    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:23.442163 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:23.442003    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:23.442163 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:23.442097    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:27.442083229 +0000 UTC m=+41.061569441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:24.104219 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:24.104178    2549 generic.go:356] "Generic (PLEG): container finished" podID="da6adb52-fab5-4808-a01d-18082a3b1b98" containerID="65cfae88d98362fcf985ad9389f3ae041c8e73dbaa27c78f9ae8632c11f6fba4" exitCode=0
Jun 03 19:31:24.104660 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:24.104270    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerDied","Data":"65cfae88d98362fcf985ad9389f3ae041c8e73dbaa27c78f9ae8632c11f6fba4"}
Jun 03 19:31:24.106551 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:24.106502    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhn2c" event={"ID":"d27be6a6-e7d6-4f39-833c-c2a3bb1de913","Type":"ContainerStarted","Data":"1954d2d28ff0028301f211129b1473b9d9c06a0d11e45666f78ba2f391e25e42"}
Jun 03 19:31:24.146581 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:24.146248    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qhn2c" podStartSLOduration=2.233941531 podStartE2EDuration="5.146225877s" totalImagesPullingTime="2.912284346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:24.144862995 +0000 UTC m=+37.764349231" watchObservedRunningTime="2026-06-03 19:31:24.146225877 +0000 UTC m=+37.765712116"
Jun 03 19:31:25.113937 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:25.113847    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d96mp" event={"ID":"da6adb52-fab5-4808-a01d-18082a3b1b98","Type":"ContainerStarted","Data":"4802c82835e2788d20a7f6dd91a89cc195a310b9cd6e8f2c641e6e2eb3134eec"}
Jun 03 19:31:25.135721 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:25.135663    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d96mp" podStartSLOduration=10.195318867 podStartE2EDuration="39.135643615s" totalImagesPullingTime="28.940324748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:25.134352292 +0000 UTC m=+38.753838538" watchObservedRunningTime="2026-06-03 19:31:25.135643615 +0000 UTC m=+38.755129849"
Jun 03 19:31:27.474576 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:27.474542    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:27.474941 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:27.474681    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:27.474941 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:27.474740    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:35.47472511 +0000 UTC m=+49.094211327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:28.122945 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:28.122906    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerStarted","Data":"d021a35e99a00b59094a8adeeb8fb2eb17f7e6afd15996aab4a9d69279b85403"}
Jun 03 19:31:28.123162 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:28.122956    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerStarted","Data":"b5cbf8dcda725191ecb480010cf1662ec3c063896fab9da96f3cdf88835034d2"}
Jun 03 19:31:28.123162 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:28.122973    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerStarted","Data":"d420679c4181a106cbf85ddab4dcb23b7627c827c1ac3647e0c3b4bddcdf126f"}
Jun 03 19:31:28.140685 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:28.140630    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" podStartSLOduration=2.034991939 podStartE2EDuration="6.140615332s" totalImagesPullingTime="4.105623393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:28.140171252 +0000 UTC m=+41.759657498" watchObservedRunningTime="2026-06-03 19:31:28.140615332 +0000 UTC m=+41.760101566"
Jun 03 19:31:35.530456 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:35.530413    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:35.530959 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:35.530535    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:35.530959 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:35.530590    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:31:51.530576282 +0000 UTC m=+65.150062495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:47.081809 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:47.081730    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9gnk"
Jun 03 19:31:51.532125 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.532083    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:31:51.532555 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.532142    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:31:51.532555 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:51.532241    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:31:51.532555 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:51.532306    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:32:23.532287033 +0000 UTC m=+97.151773249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:31:51.534463 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.534445    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 19:31:51.542549 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:51.542520    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 19:31:51.542614 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:31:51.542585    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:32:55.542568778 +0000 UTC m=+129.162054994 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : secret "metrics-daemon-secret" not found
Jun 03 19:31:51.632457 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.632422    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:51.634716 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.634692    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 19:31:51.646636 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.646608    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11cad0a4-1bad-4f59-a486-66fa414c782b-original-pull-secret\") pod \"global-pull-secret-syncer-lzbk7\" (UID: \"11cad0a4-1bad-4f59-a486-66fa414c782b\") " pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:51.732747 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.732702    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:51.735426 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.735406    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 19:31:51.739348 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.739332    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lzbk7"
Jun 03 19:31:51.745096 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.745078    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 19:31:51.756472 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.756447    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svcx\" (UniqueName: \"kubernetes.io/projected/fc040914-7cee-41ef-8a8d-7460f3cc201a-kube-api-access-7svcx\") pod \"network-check-target-ssts6\" (UID: \"fc040914-7cee-41ef-8a8d-7460f3cc201a\") " pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:51.857782 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:51.857726    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lzbk7"]
Jun 03 19:31:52.055129 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:52.055048    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4d4w5\""
Jun 03 19:31:52.063210 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:52.063192    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:52.180248 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:52.180209    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lzbk7" event={"ID":"11cad0a4-1bad-4f59-a486-66fa414c782b","Type":"ContainerStarted","Data":"0eebf5c81a5ec7602c1397843921b3c8ad48c332e4f3d3f05f2df31126342b70"}
Jun 03 19:31:52.184801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:52.184773    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssts6"]
Jun 03 19:31:52.187337 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:31:52.187311    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc040914_7cee_41ef_8a8d_7460f3cc201a.slice/crio-3a2eb02106f6efee6df25f7e3f76d6b591f2c0b19cbc41382b6d676a961c8864 WatchSource:0}: Error finding container 3a2eb02106f6efee6df25f7e3f76d6b591f2c0b19cbc41382b6d676a961c8864: Status 404 returned error can't find the container with id 3a2eb02106f6efee6df25f7e3f76d6b591f2c0b19cbc41382b6d676a961c8864
Jun 03 19:31:53.185157 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:53.185067    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssts6" event={"ID":"fc040914-7cee-41ef-8a8d-7460f3cc201a","Type":"ContainerStarted","Data":"3a2eb02106f6efee6df25f7e3f76d6b591f2c0b19cbc41382b6d676a961c8864"}
Jun 03 19:31:57.197915 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:57.197879    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssts6" event={"ID":"fc040914-7cee-41ef-8a8d-7460f3cc201a","Type":"ContainerStarted","Data":"a2bd126d6c4a321c45cb401b06d34577ac3d2a0b6c18989f25c2cfd94342b150"}
Jun 03 19:31:57.198380 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:57.198005    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:31:57.199342 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:57.199320    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lzbk7" event={"ID":"11cad0a4-1bad-4f59-a486-66fa414c782b","Type":"ContainerStarted","Data":"1fa2c73a6a1d8b714e0b3a5b6a8323aa3bbfe34d1e22b757ccc126faf5b0b505"}
Jun 03 19:31:57.213043 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:57.213001    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ssts6" podStartSLOduration=65.83234847 podStartE2EDuration="1m10.212987174s" totalImagesPullingTime="4.380638704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:57.212631843 +0000 UTC m=+70.832118079" watchObservedRunningTime="2026-06-03 19:31:57.212987174 +0000 UTC m=+70.832473409"
Jun 03 19:31:57.228023 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:31:57.227971    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lzbk7" podStartSLOduration=65.51818612 podStartE2EDuration="1m10.227956697s" totalImagesPullingTime="4.709770577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:57.227163933 +0000 UTC m=+70.846650168" watchObservedRunningTime="2026-06-03 19:31:57.227956697 +0000 UTC m=+70.847442932"
Jun 03 19:32:23.545129 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:32:23.545091    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:32:23.545511 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:32:23.545198    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:32:23.545511 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:32:23.545259    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:33:27.545246001 +0000 UTC m=+161.164732214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:32:28.205268 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:32:28.205239    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ssts6"
Jun 03 19:32:55.559040 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:32:55.558992    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:32:55.559427 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:32:55.559149    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 19:32:55.559427 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:32:55.559230    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:34:57.559210702 +0000 UTC m=+251.178696916 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : secret "metrics-daemon-secret" not found
Jun 03 19:33:22.749530 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:33:22.749466    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-55gbb" podUID="70377450-eb03-41eb-baf9-fe3cc22d8df8"
Jun 03 19:33:23.443709 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:33:23.443680    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:33:23.846472 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:33:23.846367    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:33:27.589515 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:33:27.589470    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:33:27.589939 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:33:27.589621    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 19:33:27.589939 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:33:27.589687    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls podName:70377450-eb03-41eb-baf9-fe3cc22d8df8 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:29.589671119 +0000 UTC m=+283.209157337 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls") pod "dns-default-55gbb" (UID: "70377450-eb03-41eb-baf9-fe3cc22d8df8") : secret "dns-default-metrics-tls" not found
Jun 03 19:33:34.825043 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:33:34.825010    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:34:42.863750 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.863716    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:34:42.865808 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.865785    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.870629 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.869948    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 19:34:42.872977 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.872834    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 19:34:42.875193 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.875173    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 19:34:42.875343 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.875219    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tr6t\""
Jun 03 19:34:42.877588 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.877571    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 19:34:42.883615 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.883593    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:34:42.905735 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905708    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905857 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905736    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc5s\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905857 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905792    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905857 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905842    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905901    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905926    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.905974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905945    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:42.906075 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:42.905992    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006691 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006658    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006691 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006694    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc5s\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006723    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006743    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006792    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006811    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006825    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.006946 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.006845    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.007253 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.006945    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 19:34:43.007253 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.006965    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5749b64746-8m7lc: secret "image-registry-tls" not found
Jun 03 19:34:43.007253 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.007036    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls podName:204190e6-6c18-4d5a-b3be-6c708e7ffc0d nodeName:}" failed. No retries permitted until 2026-06-03 19:34:43.507012036 +0000 UTC m=+237.126498255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls") pod "image-registry-5749b64746-8m7lc" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d") : secret "image-registry-tls" not found
Jun 03 19:34:43.007411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.007249    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.007411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.007375    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.007704 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.007686    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.009126 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.009103    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.009344 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.009320    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.015095 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.015071    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.015430 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.015409    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc5s\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.511362 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:43.511325    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:43.511535 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.511474    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 19:34:43.511535 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.511495    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5749b64746-8m7lc: secret "image-registry-tls" not found
Jun 03 19:34:43.511611 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:43.511561    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls podName:204190e6-6c18-4d5a-b3be-6c708e7ffc0d nodeName:}" failed. No retries permitted until 2026-06-03 19:34:44.511544872 +0000 UTC m=+238.131031085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls") pod "image-registry-5749b64746-8m7lc" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d") : secret "image-registry-tls" not found
Jun 03 19:34:44.517973 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:44.517936    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:44.518341 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:44.518055    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 19:34:44.518341 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:44.518066    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5749b64746-8m7lc: secret "image-registry-tls" not found
Jun 03 19:34:44.518341 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:44.518121    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls podName:204190e6-6c18-4d5a-b3be-6c708e7ffc0d nodeName:}" failed. No retries permitted until 2026-06-03 19:34:46.518107197 +0000 UTC m=+240.137593411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls") pod "image-registry-5749b64746-8m7lc" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d") : secret "image-registry-tls" not found
Jun 03 19:34:46.532467 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:46.532431    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:46.532899 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:46.532552    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 19:34:46.532899 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:46.532564    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5749b64746-8m7lc: secret "image-registry-tls" not found
Jun 03 19:34:46.532899 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:46.532608    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls podName:204190e6-6c18-4d5a-b3be-6c708e7ffc0d nodeName:}" failed. No retries permitted until 2026-06-03 19:34:50.532595641 +0000 UTC m=+244.152081854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls") pod "image-registry-5749b64746-8m7lc" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d") : secret "image-registry-tls" not found
Jun 03 19:34:50.331944 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:50.331913    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hc2sd_2c7fed49-86de-423a-b51c-f30d6576e27e/dns-node-resolver/0.log"
Jun 03 19:34:50.559571 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:50.559528    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:50.559716 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:50.559674    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 19:34:50.559716 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:50.559691    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5749b64746-8m7lc: secret "image-registry-tls" not found
Jun 03 19:34:50.559852 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:50.559753    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls podName:204190e6-6c18-4d5a-b3be-6c708e7ffc0d nodeName:}" failed. No retries permitted until 2026-06-03 19:34:58.559738568 +0000 UTC m=+252.179224781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls") pod "image-registry-5749b64746-8m7lc" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d") : secret "image-registry-tls" not found
Jun 03 19:34:51.134287 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:51.134254    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8dnw_9928cd71-078a-4579-87af-e1868957cf2f/node-ca/0.log"
Jun 03 19:34:52.132535 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:52.132508    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhn2c_d27be6a6-e7d6-4f39-833c-c2a3bb1de913/serve-healthcheck-canary/0.log"
Jun 03 19:34:57.612588 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:57.612503    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:34:57.613051 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:57.612654    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 19:34:57.613051 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:34:57.612726    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs podName:0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3 nodeName:}" failed. No retries permitted until 2026-06-03 19:36:59.612709459 +0000 UTC m=+373.232195684 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs") pod "network-metrics-daemon-nc4kc" (UID: "0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3") : secret "metrics-daemon-secret" not found
Jun 03 19:34:58.621043 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:58.621007    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:58.623472 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:58.623446    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"image-registry-5749b64746-8m7lc\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") " pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:58.779146 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:58.779113    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tr6t\""
Jun 03 19:34:58.787470 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:58.787443    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:58.912168 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:58.912134    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:34:58.915381 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:34:58.915354    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204190e6_6c18_4d5a_b3be_6c708e7ffc0d.slice/crio-5fe6fe40555eb9b1b9a7d2ca5c4c7a4a254a73a35ef09ca03d1c48d843a44d39 WatchSource:0}: Error finding container 5fe6fe40555eb9b1b9a7d2ca5c4c7a4a254a73a35ef09ca03d1c48d843a44d39: Status 404 returned error can't find the container with id 5fe6fe40555eb9b1b9a7d2ca5c4c7a4a254a73a35ef09ca03d1c48d843a44d39
Jun 03 19:34:59.715683 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:59.715644    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" event={"ID":"204190e6-6c18-4d5a-b3be-6c708e7ffc0d","Type":"ContainerStarted","Data":"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"}
Jun 03 19:34:59.716102 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:59.715692    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" event={"ID":"204190e6-6c18-4d5a-b3be-6c708e7ffc0d","Type":"ContainerStarted","Data":"5fe6fe40555eb9b1b9a7d2ca5c4c7a4a254a73a35ef09ca03d1c48d843a44d39"}
Jun 03 19:34:59.716102 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:59.715786    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:34:59.734654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:34:59.734604    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" podStartSLOduration=17.734588626 podStartE2EDuration="17.734588626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:59.732936642 +0000 UTC m=+253.352422877" watchObservedRunningTime="2026-06-03 19:34:59.734588626 +0000 UTC m=+253.354074851"
Jun 03 19:35:02.464629 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:02.464570    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" podUID="6206a864-54e6-4cee-8298-96d8268657ba" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 19:35:12.143932 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.143895    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gskhp"]
Jun 03 19:35:12.147642 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.147619    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.150935 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.150913    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 19:35:12.151047 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.150919    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 19:35:12.151786 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.151770    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 19:35:12.151831 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.151781    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qkz7f\""
Jun 03 19:35:12.151870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.151828    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 19:35:12.157528 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.157509    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-4c8jc"]
Jun 03 19:35:12.159354 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.159340    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:12.162721 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.162698    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2f9g6\""
Jun 03 19:35:12.162915 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.162719    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gskhp"]
Jun 03 19:35:12.162915 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.162791    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 19:35:12.162915 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.162848    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 19:35:12.163733 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.163716    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:35:12.177988 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.177944    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-4c8jc"]
Jun 03 19:35:12.224732 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.224700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ebc8171-e1c7-433a-943d-caddca0b9632-crio-socket\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.224911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.224751    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ebc8171-e1c7-433a-943d-caddca0b9632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.224911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.224825    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.224911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.224866    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fhm\" (UniqueName: \"kubernetes.io/projected/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-api-access-g8fhm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.225017 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.224921    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ebc8171-e1c7-433a-943d-caddca0b9632-data-volume\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325469 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325433    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ebc8171-e1c7-433a-943d-caddca0b9632-crio-socket\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325675 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325488    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ebc8171-e1c7-433a-943d-caddca0b9632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325675 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325517    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325675 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325537    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fhm\" (UniqueName: \"kubernetes.io/projected/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-api-access-g8fhm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325675 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325592    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqnb\" (UniqueName: \"kubernetes.io/projected/9c32c03b-331b-47c8-b4e3-3c25f706ab47-kube-api-access-2wqnb\") pod \"downloads-56b467f5ff-4c8jc\" (UID: \"9c32c03b-331b-47c8-b4e3-3c25f706ab47\") " pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:12.325675 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325635    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ebc8171-e1c7-433a-943d-caddca0b9632-data-volume\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.325973 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.325712    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ebc8171-e1c7-433a-943d-caddca0b9632-crio-socket\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.326029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.326005    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ebc8171-e1c7-433a-943d-caddca0b9632-data-volume\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.326140 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.326122    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.327895 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.327876    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ebc8171-e1c7-433a-943d-caddca0b9632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.332932 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.332901    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fhm\" (UniqueName: \"kubernetes.io/projected/8ebc8171-e1c7-433a-943d-caddca0b9632-kube-api-access-g8fhm\") pod \"insights-runtime-extractor-gskhp\" (UID: \"8ebc8171-e1c7-433a-943d-caddca0b9632\") " pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.426451 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.426414    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqnb\" (UniqueName: \"kubernetes.io/projected/9c32c03b-331b-47c8-b4e3-3c25f706ab47-kube-api-access-2wqnb\") pod \"downloads-56b467f5ff-4c8jc\" (UID: \"9c32c03b-331b-47c8-b4e3-3c25f706ab47\") " pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:12.433886 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.433861    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqnb\" (UniqueName: \"kubernetes.io/projected/9c32c03b-331b-47c8-b4e3-3c25f706ab47-kube-api-access-2wqnb\") pod \"downloads-56b467f5ff-4c8jc\" (UID: \"9c32c03b-331b-47c8-b4e3-3c25f706ab47\") " pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:12.456850 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.456821    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gskhp"
Jun 03 19:35:12.463915 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.463877    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" podUID="6206a864-54e6-4cee-8298-96d8268657ba" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 19:35:12.469060 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.469029    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:12.591367 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.591329    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gskhp"]
Jun 03 19:35:12.595332 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:12.595297    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebc8171_e1c7_433a_943d_caddca0b9632.slice/crio-a01d52705851a8c77606a1cb2c17dd297aa2305eaeec12ccdfd1b97d9f2ef06e WatchSource:0}: Error finding container a01d52705851a8c77606a1cb2c17dd297aa2305eaeec12ccdfd1b97d9f2ef06e: Status 404 returned error can't find the container with id a01d52705851a8c77606a1cb2c17dd297aa2305eaeec12ccdfd1b97d9f2ef06e
Jun 03 19:35:12.602922 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.602897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-4c8jc"]
Jun 03 19:35:12.606047 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:12.606023    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c32c03b_331b_47c8_b4e3_3c25f706ab47.slice/crio-39d334db0d2130ae69092e086d374ac957174e294925996a024f890d69573b11 WatchSource:0}: Error finding container 39d334db0d2130ae69092e086d374ac957174e294925996a024f890d69573b11: Status 404 returned error can't find the container with id 39d334db0d2130ae69092e086d374ac957174e294925996a024f890d69573b11
Jun 03 19:35:12.751445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.751367    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-4c8jc" event={"ID":"9c32c03b-331b-47c8-b4e3-3c25f706ab47","Type":"ContainerStarted","Data":"39d334db0d2130ae69092e086d374ac957174e294925996a024f890d69573b11"}
Jun 03 19:35:12.752814 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.752782    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gskhp" event={"ID":"8ebc8171-e1c7-433a-943d-caddca0b9632","Type":"ContainerStarted","Data":"8b5b7460992668bd33532ce222d384130bed9230b2eeca40b1050a80af90fc3a"}
Jun 03 19:35:12.752918 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:12.752847    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gskhp" event={"ID":"8ebc8171-e1c7-433a-943d-caddca0b9632","Type":"ContainerStarted","Data":"a01d52705851a8c77606a1cb2c17dd297aa2305eaeec12ccdfd1b97d9f2ef06e"}
Jun 03 19:35:13.757691 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:13.757650    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gskhp" event={"ID":"8ebc8171-e1c7-433a-943d-caddca0b9632","Type":"ContainerStarted","Data":"825d62b132567d61ccc922cd05cf54c697b67f9d2216956030b07d457dc87a93"}
Jun 03 19:35:15.768004 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:15.767962    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gskhp" event={"ID":"8ebc8171-e1c7-433a-943d-caddca0b9632","Type":"ContainerStarted","Data":"ecf0c34db79252dae2f097e6813dee796ed58d9acea4dabd4fc119baf386b4d2"}
Jun 03 19:35:15.786502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:15.786448    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gskhp" podStartSLOduration=1.44100237 podStartE2EDuration="3.786431248s" totalImagesPullingTime="2.345428878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:15.784861983 +0000 UTC m=+269.404348220" watchObservedRunningTime="2026-06-03 19:35:15.786431248 +0000 UTC m=+269.405917482"
Jun 03 19:35:20.679941 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.679900    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"]
Jun 03 19:35:20.682197 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.682174    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.685483 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685457    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 19:35:20.685604 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685482    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-67jqx\""
Jun 03 19:35:20.685604 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685494    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 19:35:20.685604 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685523    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 19:35:20.685604 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685469    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 03 19:35:20.685881 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.685860    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 03 19:35:20.691594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.691572    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"]
Jun 03 19:35:20.796236 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.796204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.796434 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.796248    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.796434 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.796283    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v689w\" (UniqueName: \"kubernetes.io/projected/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-kube-api-access-v689w\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.796434 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.796422    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.897550 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.897518    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.897779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.897604    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.897779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.897637    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.897779 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:20.897642    2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 03 19:35:20.897779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.897665    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v689w\" (UniqueName: \"kubernetes.io/projected/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-kube-api-access-v689w\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.897779 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:20.897726    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls podName:2f35244b-304d-4ae6-abee-2bd7d3ea91f9 nodeName:}" failed. No retries permitted until 2026-06-03 19:35:21.39770465 +0000 UTC m=+275.017190863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-hgqzq" (UID: "2f35244b-304d-4ae6-abee-2bd7d3ea91f9") : secret "prometheus-operator-tls" not found
Jun 03 19:35:20.898413 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.898390    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.900325 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.900304    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:20.906141 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:20.906116    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v689w\" (UniqueName: \"kubernetes.io/projected/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-kube-api-access-v689w\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:21.400911 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:21.400874    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:21.403497 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:21.403473    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f35244b-304d-4ae6-abee-2bd7d3ea91f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hgqzq\" (UID: \"2f35244b-304d-4ae6-abee-2bd7d3ea91f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:21.593438 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:21.593398    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"
Jun 03 19:35:21.726124 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:21.726084    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq"]
Jun 03 19:35:21.728484 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:21.728461    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f35244b_304d_4ae6_abee_2bd7d3ea91f9.slice/crio-ab582d0564cccaae3bbaac9536386f46f13e557e625c175e5dcea6c98bba7d93 WatchSource:0}: Error finding container ab582d0564cccaae3bbaac9536386f46f13e557e625c175e5dcea6c98bba7d93: Status 404 returned error can't find the container with id ab582d0564cccaae3bbaac9536386f46f13e557e625c175e5dcea6c98bba7d93
Jun 03 19:35:21.789335 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:21.789293    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq" event={"ID":"2f35244b-304d-4ae6-abee-2bd7d3ea91f9","Type":"ContainerStarted","Data":"ab582d0564cccaae3bbaac9536386f46f13e557e625c175e5dcea6c98bba7d93"}
Jun 03 19:35:22.169595 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.169556    2549 patch_prober.go:28] interesting pod/image-registry-5749b64746-8m7lc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 19:35:22.169779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.169657    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:35:22.464804 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.464699    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" podUID="6206a864-54e6-4cee-8298-96d8268657ba" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 19:35:22.464804 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.464794    2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf"
Jun 03 19:35:22.465384 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.465344    2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d021a35e99a00b59094a8adeeb8fb2eb17f7e6afd15996aab4a9d69279b85403"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 03 19:35:22.465478 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:22.465404    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" podUID="6206a864-54e6-4cee-8298-96d8268657ba" containerName="service-proxy" containerID="cri-o://d021a35e99a00b59094a8adeeb8fb2eb17f7e6afd15996aab4a9d69279b85403" gracePeriod=30
Jun 03 19:35:26.445166 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:26.445117    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-55gbb" podUID="70377450-eb03-41eb-baf9-fe3cc22d8df8"
Jun 03 19:35:26.811324 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:26.811234    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:29.672442 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.672224    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:29.675876 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.675729    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70377450-eb03-41eb-baf9-fe3cc22d8df8-metrics-tls\") pod \"dns-default-55gbb\" (UID: \"70377450-eb03-41eb-baf9-fe3cc22d8df8\") " pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:29.814840 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.814782    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-84p4r\""
Jun 03 19:35:29.822717 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.822683    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:29.826070 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.826028    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerDied","Data":"d021a35e99a00b59094a8adeeb8fb2eb17f7e6afd15996aab4a9d69279b85403"}
Jun 03 19:35:29.826269 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.826239    2549 generic.go:356] "Generic (PLEG): container finished" podID="6206a864-54e6-4cee-8298-96d8268657ba" containerID="d021a35e99a00b59094a8adeeb8fb2eb17f7e6afd15996aab4a9d69279b85403" exitCode=2
Jun 03 19:35:29.826370 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.826350    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d5d8b6f9f-fdsrf" event={"ID":"6206a864-54e6-4cee-8298-96d8268657ba","Type":"ContainerStarted","Data":"7cd5ce97d8ce3cdfe4b70509f6ce565404e9faea4565243bab17d9a2bcf8f23d"}
Jun 03 19:35:29.830962 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.830932    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-4c8jc" event={"ID":"9c32c03b-331b-47c8-b4e3-3c25f706ab47","Type":"ContainerStarted","Data":"9fb3c640e18dec30606ace21b1af833d16eea7b9a4d299c1b2a1bcd778242dd5"}
Jun 03 19:35:29.832295 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.832227    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:29.844446 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.844391    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-4c8jc"
Jun 03 19:35:29.859226 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.858751    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-4c8jc" podStartSLOduration=1.124832262 podStartE2EDuration="17.858731769s" totalImagesPullingTime="16.733899507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:29.858021225 +0000 UTC m=+283.477507462" watchObservedRunningTime="2026-06-03 19:35:29.858731769 +0000 UTC m=+283.478218004"
Jun 03 19:35:29.999243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:29.999206    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-55gbb"]
Jun 03 19:35:30.287342 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:30.287260    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70377450_eb03_41eb_baf9_fe3cc22d8df8.slice/crio-58aa288b3b90aa11cc26b6ff03926cf2d850f7f6540b2da7c5ad86f1ef8cb7f6 WatchSource:0}: Error finding container 58aa288b3b90aa11cc26b6ff03926cf2d850f7f6540b2da7c5ad86f1ef8cb7f6: Status 404 returned error can't find the container with id 58aa288b3b90aa11cc26b6ff03926cf2d850f7f6540b2da7c5ad86f1ef8cb7f6
Jun 03 19:35:30.839243 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:30.839200    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55gbb" event={"ID":"70377450-eb03-41eb-baf9-fe3cc22d8df8","Type":"ContainerStarted","Data":"58aa288b3b90aa11cc26b6ff03926cf2d850f7f6540b2da7c5ad86f1ef8cb7f6"}
Jun 03 19:35:30.842510 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:30.842475    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq" event={"ID":"2f35244b-304d-4ae6-abee-2bd7d3ea91f9","Type":"ContainerStarted","Data":"7c6ae08bfb9c1ce2ee01ce1f5eb7f4f6649c0e4036e90cf1c8ebf6abe7fa8932"}
Jun 03 19:35:30.842652 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:30.842540    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq" event={"ID":"2f35244b-304d-4ae6-abee-2bd7d3ea91f9","Type":"ContainerStarted","Data":"d0511413d10e4027397ddc278ca8de720a119eadad0000d5e0f56ac138c5ff98"}
Jun 03 19:35:30.862320 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:30.862261    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hgqzq" podStartSLOduration=2.246432984 podStartE2EDuration="10.862240684s" totalImagesPullingTime="8.6158077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:30.861411624 +0000 UTC m=+284.480897861" watchObservedRunningTime="2026-06-03 19:35:30.862240684 +0000 UTC m=+284.481726924"
Jun 03 19:35:32.169576 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.169539    2549 patch_prober.go:28] interesting pod/image-registry-5749b64746-8m7lc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 19:35:32.169998 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.169597    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:35:32.852660 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.852620    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55gbb" event={"ID":"70377450-eb03-41eb-baf9-fe3cc22d8df8","Type":"ContainerStarted","Data":"9342fb23e7c3912ee6e0401043f4f8b4df2b15ad8108ed2812f3687e72f13952"}
Jun 03 19:35:32.852846 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.852693    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55gbb" event={"ID":"70377450-eb03-41eb-baf9-fe3cc22d8df8","Type":"ContainerStarted","Data":"1d1b5e9aef7ceb204d90cabcafda89b36d31ef5511b7aed9349254dad0ac5a9e"}
Jun 03 19:35:32.852846 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.852815    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:32.869025 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:32.868960    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-55gbb" podStartSLOduration=251.673618548 podStartE2EDuration="4m13.868942027s" totalImagesPullingTime="2.195323479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:32.868847445 +0000 UTC m=+286.488333680" watchObservedRunningTime="2026-06-03 19:35:32.868942027 +0000 UTC m=+286.488428262"
Jun 03 19:35:33.027292 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.027216    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"]
Jun 03 19:35:33.042057 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.042030    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.043591 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.042420    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9vqws"]
Jun 03 19:35:33.044893 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.044864    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 03 19:35:33.045244 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.045219    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 03 19:35:33.045348 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.045248    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rhz7v\""
Jun 03 19:35:33.045348 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.045326    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 03 19:35:33.060869 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.060834    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"]
Jun 03 19:35:33.060989 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.060962    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.062959 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.062940    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 19:35:33.063107 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.062955    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 19:35:33.063791 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.063751    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 19:35:33.063891 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.063811    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgvtv\""
Jun 03 19:35:33.104053 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104014    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwhfz\" (UniqueName: \"kubernetes.io/projected/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-api-access-qwhfz\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104231 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104064    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-textfile\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104231 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104098    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104231 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104133    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-metrics-client-ca\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104231 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104154    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-sys\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104231 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af83bd92-5576-4505-b98c-7a11c3eba6ae-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104241    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104317    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104378    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-root\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104408    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-tls\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104433    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-wtmp\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104487 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104458    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104751 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104506    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjjl\" (UniqueName: \"kubernetes.io/projected/ab8e4b95-8743-4642-9eef-bfa38aba76bd-kube-api-access-2rjjl\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.104751 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104534    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.104751 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.104554    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.205627 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205564    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-root\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.205627 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205627    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-tls\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205652    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-wtmp\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205677    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205677    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-root\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205706    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjjl\" (UniqueName: \"kubernetes.io/projected/ab8e4b95-8743-4642-9eef-bfa38aba76bd-kube-api-access-2rjjl\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205736    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205781    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205845    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwhfz\" (UniqueName: \"kubernetes.io/projected/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-api-access-qwhfz\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205875    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-textfile\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205902    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-wtmp\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205906    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205956    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-metrics-client-ca\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.205990    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-sys\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206020    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af83bd92-5576-4505-b98c-7a11c3eba6ae-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206045    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.206207 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206076    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206231    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8e4b95-8743-4642-9eef-bfa38aba76bd-sys\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206330    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-textfile\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af83bd92-5576-4505-b98c-7a11c3eba6ae-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206658    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:33.206708    2549 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206708    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af83bd92-5576-4505-b98c-7a11c3eba6ae-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:33.206794    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls podName:af83bd92-5576-4505-b98c-7a11c3eba6ae nodeName:}" failed. No retries permitted until 2026-06-03 19:35:33.706750575 +0000 UTC m=+287.326236804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls") pod "kube-state-metrics-79fb7d47d4-g8mq5" (UID: "af83bd92-5576-4505-b98c-7a11c3eba6ae") : secret "kube-state-metrics-tls" not found
Jun 03 19:35:33.207012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.206860    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-metrics-client-ca\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.207455 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.207246    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.208721 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.208696    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-tls\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.209059 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.209038    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab8e4b95-8743-4642-9eef-bfa38aba76bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.209677 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.209652    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.217366 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.217320    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjjl\" (UniqueName: \"kubernetes.io/projected/ab8e4b95-8743-4642-9eef-bfa38aba76bd-kube-api-access-2rjjl\") pod \"node-exporter-9vqws\" (UID: \"ab8e4b95-8743-4642-9eef-bfa38aba76bd\") " pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.217589 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.217564    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwhfz\" (UniqueName: \"kubernetes.io/projected/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-api-access-qwhfz\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.371310 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.371234    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vqws"
Jun 03 19:35:33.398415 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:33.398374    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8e4b95_8743_4642_9eef_bfa38aba76bd.slice/crio-85e0dce52a6a59289cb6643ce56efcf43451fe470b4686d499857ba3e8e11279 WatchSource:0}: Error finding container 85e0dce52a6a59289cb6643ce56efcf43451fe470b4686d499857ba3e8e11279: Status 404 returned error can't find the container with id 85e0dce52a6a59289cb6643ce56efcf43451fe470b4686d499857ba3e8e11279
Jun 03 19:35:33.709740 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.709698    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.712536 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.712502    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af83bd92-5576-4505-b98c-7a11c3eba6ae-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-g8mq5\" (UID: \"af83bd92-5576-4505-b98c-7a11c3eba6ae\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:33.858047 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.858001    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqws" event={"ID":"ab8e4b95-8743-4642-9eef-bfa38aba76bd","Type":"ContainerStarted","Data":"85e0dce52a6a59289cb6643ce56efcf43451fe470b4686d499857ba3e8e11279"}
Jun 03 19:35:33.954131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:33.954031    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"
Jun 03 19:35:34.185625 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:34.185109    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5"]
Jun 03 19:35:34.190329 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:34.190290    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf83bd92_5576_4505_b98c_7a11c3eba6ae.slice/crio-630960e7e7565e2869741321ed8a6d8e2f02a931ad54fb178b260f291c904bf6 WatchSource:0}: Error finding container 630960e7e7565e2869741321ed8a6d8e2f02a931ad54fb178b260f291c904bf6: Status 404 returned error can't find the container with id 630960e7e7565e2869741321ed8a6d8e2f02a931ad54fb178b260f291c904bf6
Jun 03 19:35:34.863483 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:34.863444    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5" event={"ID":"af83bd92-5576-4505-b98c-7a11c3eba6ae","Type":"ContainerStarted","Data":"630960e7e7565e2869741321ed8a6d8e2f02a931ad54fb178b260f291c904bf6"}
Jun 03 19:35:35.869438 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:35.869399    2549 generic.go:356] "Generic (PLEG): container finished" podID="ab8e4b95-8743-4642-9eef-bfa38aba76bd" containerID="6111a89f7c39f48f4e51ddf5acdccf0224735b78d379a08f43189606438715a4" exitCode=0
Jun 03 19:35:35.869438 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:35.869447    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqws" event={"ID":"ab8e4b95-8743-4642-9eef-bfa38aba76bd","Type":"ContainerDied","Data":"6111a89f7c39f48f4e51ddf5acdccf0224735b78d379a08f43189606438715a4"}
Jun 03 19:35:36.876158 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.876118    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqws" event={"ID":"ab8e4b95-8743-4642-9eef-bfa38aba76bd","Type":"ContainerStarted","Data":"d8881b6ff9d90b0f8e9bc722da70c7d549f3bae2c273c9e65a81668c117c6e29"}
Jun 03 19:35:36.876631 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.876181    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqws" event={"ID":"ab8e4b95-8743-4642-9eef-bfa38aba76bd","Type":"ContainerStarted","Data":"436406c947119b94f749a6d3cc54b8386c77a85d27d6f79b6c2f2cb2e833a0cf"}
Jun 03 19:35:36.878914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.878878    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5" event={"ID":"af83bd92-5576-4505-b98c-7a11c3eba6ae","Type":"ContainerStarted","Data":"2c6270d7dd189a2a1b98859c4fb94205b4dfee7ac60709e80ba302e05296d9ed"}
Jun 03 19:35:36.879037 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.878950    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5" event={"ID":"af83bd92-5576-4505-b98c-7a11c3eba6ae","Type":"ContainerStarted","Data":"1b5df0cbab8f7e530fedf88663078ff6a97dcedc9117f1dd6fffcd726b271792"}
Jun 03 19:35:36.879037 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.878979    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5" event={"ID":"af83bd92-5576-4505-b98c-7a11c3eba6ae","Type":"ContainerStarted","Data":"fe35b6491026cecf74c0f816ba222fa8cfd416d3c301cf6e01fee8ad72877acf"}
Jun 03 19:35:36.894160 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.894083    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9vqws" podStartSLOduration=2.195197423 podStartE2EDuration="3.894064778s" totalImagesPullingTime="1.593183903s" totalInitContainerRuntime="105.683452ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:36.892740024 +0000 UTC m=+290.512226261" watchObservedRunningTime="2026-06-03 19:35:36.894064778 +0000 UTC m=+290.513551059"
Jun 03 19:35:36.911196 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:36.911149    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-g8mq5" podStartSLOduration=1.768839817 podStartE2EDuration="3.911131014s" totalImagesPullingTime="2.142291197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:36.909481576 +0000 UTC m=+290.528967812" watchObservedRunningTime="2026-06-03 19:35:36.911131014 +0000 UTC m=+290.530617250"
Jun 03 19:35:37.184268 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.184214    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry" containerID="cri-o://3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94" gracePeriod=30
Jun 03 19:35:37.410568 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.410533    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"]
Jun 03 19:35:37.434100 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.434037    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"]
Jun 03 19:35:37.434268 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.434157    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.438197 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.438133    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 19:35:37.438330 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.438269    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nsp8p\""
Jun 03 19:35:37.439700 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.439202    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 03 19:35:37.439700 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.439322    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 03 19:35:37.439700 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.439518    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 03 19:35:37.440088 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.440065    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b2dhd1ba7cnj2\""
Jun 03 19:35:37.488504 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.488464    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:35:37.544994 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.544963    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545183 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545002    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545183 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545029    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545183 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545073    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545185    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545241    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc5s\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545299    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545338    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token\") pod \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\" (UID: \"204190e6-6c18-4d5a-b3be-6c708e7ffc0d\") "
Jun 03 19:35:37.545553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545391    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:35:37.545553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-tls\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545553 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545534    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-client-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545623    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545627    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545666    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-metrics-server-audit-profiles\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545699    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3568cf18-2521-4618-ab47-c55d93caaa4e-audit-log\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545736    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q9r5\" (UniqueName: \"kubernetes.io/projected/3568cf18-2521-4618-ab47-c55d93caaa4e-kube-api-access-5q9r5\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.545801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545794    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-client-certs\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.546101 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545841    2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-certificates\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.546101 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.545858    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-trusted-ca\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.548018 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.547935    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:35:37.548154 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.548066    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:35:37.548223 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.548149    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:35:37.549000 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.548971    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s" (OuterVolumeSpecName: "kube-api-access-rbc5s") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "kube-api-access-rbc5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:35:37.549558 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.549523    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:35:37.557584 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.557556    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "204190e6-6c18-4d5a-b3be-6c708e7ffc0d" (UID: "204190e6-6c18-4d5a-b3be-6c708e7ffc0d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:35:37.646218 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646180    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646231    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-metrics-server-audit-profiles\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646263    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3568cf18-2521-4618-ab47-c55d93caaa4e-audit-log\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646295    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q9r5\" (UniqueName: \"kubernetes.io/projected/3568cf18-2521-4618-ab47-c55d93caaa4e-kube-api-access-5q9r5\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646324    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-client-certs\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646373    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-tls\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646407 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646394    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-client-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646451    2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-image-registry-private-configuration\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646471    2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-bound-sa-token\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646486    2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-installation-pull-secrets\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646500    2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-registry-tls\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646514    2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-ca-trust-extracted\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.646722 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.646530    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc5s\" (UniqueName: \"kubernetes.io/projected/204190e6-6c18-4d5a-b3be-6c708e7ffc0d-kube-api-access-rbc5s\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:35:37.647376 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.647046    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.647495 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.647449    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3568cf18-2521-4618-ab47-c55d93caaa4e-metrics-server-audit-profiles\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.647586 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.647564    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3568cf18-2521-4618-ab47-c55d93caaa4e-audit-log\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.649402 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.649372    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-client-certs\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.649588 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.649569    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-client-ca-bundle\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.649689 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.649670    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3568cf18-2521-4618-ab47-c55d93caaa4e-secret-metrics-server-tls\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.655504 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.655482    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q9r5\" (UniqueName: \"kubernetes.io/projected/3568cf18-2521-4618-ab47-c55d93caaa4e-kube-api-access-5q9r5\") pod \"metrics-server-5b5589c6b8-cdkrx\" (UID: \"3568cf18-2521-4618-ab47-c55d93caaa4e\") " pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.747060 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.746973    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:37.825439 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:37.825394    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nc4kc" podUID="0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3"
Jun 03 19:35:37.885052 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.884997    2549 generic.go:356] "Generic (PLEG): container finished" podID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerID="3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94" exitCode=0
Jun 03 19:35:37.885491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.885142    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749b64746-8m7lc"
Jun 03 19:35:37.885491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.885180    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" event={"ID":"204190e6-6c18-4d5a-b3be-6c708e7ffc0d","Type":"ContainerDied","Data":"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"}
Jun 03 19:35:37.885491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.885223    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749b64746-8m7lc" event={"ID":"204190e6-6c18-4d5a-b3be-6c708e7ffc0d","Type":"ContainerDied","Data":"5fe6fe40555eb9b1b9a7d2ca5c4c7a4a254a73a35ef09ca03d1c48d843a44d39"}
Jun 03 19:35:37.885491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.885248    2549 scope.go:117] "RemoveContainer" containerID="3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"
Jun 03 19:35:37.900521 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.900486    2549 scope.go:117] "RemoveContainer" containerID="3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"
Jun 03 19:35:37.900915 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:35:37.900885    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94\": container with ID starting with 3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94 not found: ID does not exist" containerID="3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"
Jun 03 19:35:37.901028 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.900925    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94"} err="failed to get container status \"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94\": rpc error: code = NotFound desc = could not find container \"3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94\": container with ID starting with 3ab80430d4864e235a703af4d582fe9d8a0e094f0bc57971dc7d72e1ff82bc94 not found: ID does not exist"
Jun 03 19:35:37.912632 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.912606    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:35:37.916364 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.916337    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5749b64746-8m7lc"]
Jun 03 19:35:37.927481 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:37.927456    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"]
Jun 03 19:35:37.931088 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:37.931059    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3568cf18_2521_4618_ab47_c55d93caaa4e.slice/crio-0e35880e62f1166e0eace80744f26b13fe69110b1e17a0976dd6439b0656956b WatchSource:0}: Error finding container 0e35880e62f1166e0eace80744f26b13fe69110b1e17a0976dd6439b0656956b: Status 404 returned error can't find the container with id 0e35880e62f1166e0eace80744f26b13fe69110b1e17a0976dd6439b0656956b
Jun 03 19:35:38.830656 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:38.830621    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" path="/var/lib/kubelet/pods/204190e6-6c18-4d5a-b3be-6c708e7ffc0d/volumes"
Jun 03 19:35:38.895735 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:38.895672    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx" event={"ID":"3568cf18-2521-4618-ab47-c55d93caaa4e","Type":"ContainerStarted","Data":"0e35880e62f1166e0eace80744f26b13fe69110b1e17a0976dd6439b0656956b"}
Jun 03 19:35:39.211131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.211082    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:35:39.211713 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.211492    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry"
Jun 03 19:35:39.211713 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.211509    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry"
Jun 03 19:35:39.211713 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.211597    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="204190e6-6c18-4d5a-b3be-6c708e7ffc0d" containerName="registry"
Jun 03 19:35:39.234215 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.234176    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:35:39.234399 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.234325    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.236875 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.236850    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237134    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237208    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237141    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237394    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1nruhh4mqjk9o\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237677    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237707    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237916    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.237927    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 19:35:39.238274 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.238141    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 19:35:39.238772 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.238526    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 19:35:39.238772 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.238546    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 19:35:39.238772 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.238712    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 19:35:39.238936 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.238918    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 19:35:39.240195 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.239142    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m97j4\""
Jun 03 19:35:39.241035 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.240722    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 19:35:39.360609 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360577    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360609 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360613    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360637    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360671    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360718    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360792    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.360834 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360821    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360855    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360891    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360928    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.360994    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361019    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361084    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361146    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361179    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rhxr\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361205    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361231    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361450 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361250    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361450 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361269    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.361450 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.361291    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462060 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.461966    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462060 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462020    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462177    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462205    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462232    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462253    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462297 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462293    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.462916 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462888    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462900    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.462969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463115 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463013    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rhxr\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463115 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463044    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463115 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463066    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463115 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463096    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463121    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463143    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463192    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463216    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463250    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463277    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.463633 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.463302    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.464119 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.464090    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.464632 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.464289    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.465511 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.465490    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.466074 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.466018    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.466537 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.466516    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.467852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.467067    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.467852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.467292    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.467852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.467397    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.467852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.467615    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.467852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.467793    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.468874 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.468674    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.468962 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.468940    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.469560 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.469487    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.470717 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.470690    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.471276 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.471250    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.471375 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.471279    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.471375 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.471300    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.472443 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.472422    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rhxr\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr\") pod \"prometheus-k8s-0\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.548839 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.548703    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:39.859714 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.859679    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:35:39.863521 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:35:39.863487    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea3a0d1_6efd_44f4_83de_1343ed6cb061.slice/crio-f55097acb33e982844a01e347fb743fc2bf8d98affaec3caf8051f38bc4d57ab WatchSource:0}: Error finding container f55097acb33e982844a01e347fb743fc2bf8d98affaec3caf8051f38bc4d57ab: Status 404 returned error can't find the container with id f55097acb33e982844a01e347fb743fc2bf8d98affaec3caf8051f38bc4d57ab
Jun 03 19:35:39.901985 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:39.901946    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"f55097acb33e982844a01e347fb743fc2bf8d98affaec3caf8051f38bc4d57ab"}
Jun 03 19:35:40.913910 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:40.913870    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx" event={"ID":"3568cf18-2521-4618-ab47-c55d93caaa4e","Type":"ContainerStarted","Data":"6d0d71a750f27716528efb9a1f226b41eed60646dce7ecb92beded50eecb5a02"}
Jun 03 19:35:40.929824 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:40.929754    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx" podStartSLOduration=1.791453848 podStartE2EDuration="3.929734847s" totalImagesPullingTime="2.138280999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:40.928796265 +0000 UTC m=+294.548282501" watchObservedRunningTime="2026-06-03 19:35:40.929734847 +0000 UTC m=+294.549221084"
Jun 03 19:35:41.918315 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:41.918281    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758" exitCode=0
Jun 03 19:35:41.918755 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:41.918375    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"}
Jun 03 19:35:42.861063 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:42.861029    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-55gbb"
Jun 03 19:35:45.939304 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:45.939273    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"}
Jun 03 19:35:46.782938 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:46.782914    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:35:46.783093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:46.782946    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:35:46.788703 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:46.788684    2549 kubelet.go:1648] "Image garbage collection succeeded"
Jun 03 19:35:46.946122 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:46.946073    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"}
Jun 03 19:35:48.960972 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:48.960937    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"}
Jun 03 19:35:48.961376 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:48.961004    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"}
Jun 03 19:35:48.961376 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:48.961030    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"}
Jun 03 19:35:48.961376 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:48.961056    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerStarted","Data":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"}
Jun 03 19:35:48.992195 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:48.992124    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.223322857 podStartE2EDuration="9.992101527s" totalImagesPullingTime="7.747958059s" totalInitContainerRuntime="20.820611ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:48.990377822 +0000 UTC m=+302.609864048" watchObservedRunningTime="2026-06-03 19:35:48.992101527 +0000 UTC m=+302.611587763"
Jun 03 19:35:49.549086 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:49.549044    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:35:50.824572 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:50.824533    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:35:57.748109 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:57.748072    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:35:57.748494 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:35:57.748160    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:36:17.752999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:17.752969    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:36:17.756730 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:17.756703    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b5589c6b8-cdkrx"
Jun 03 19:36:39.549437 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:39.549395    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:39.568872 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:39.568837    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:40.156228 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:40.156189    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:57.592083 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592048    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592368    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="prometheus" containerID="cri-o://6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39" gracePeriod=600
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592390    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy" containerID="cri-o://e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4" gracePeriod=600
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592422    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="thanos-sidecar" containerID="cri-o://5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a" gracePeriod=600
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592442    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-web" containerID="cri-o://8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14" gracePeriod=600
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592464    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="config-reloader" containerID="cri-o://03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303" gracePeriod=600
Jun 03 19:36:57.592602 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.592575    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a" gracePeriod=600
Jun 03 19:36:57.841018 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.840989    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:57.948417 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948379    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948417 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948423    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948441    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948457    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948474    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948498    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948536    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948572    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948606    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.948657 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948634    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948699    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948727    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948786    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948822    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948823    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948851    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948886    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948919    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rhxr\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948953    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.948987    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949103 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.949017    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0\") pod \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\" (UID: \"4ea3a0d1-6efd-44f4-83de-1343ed6cb061\") "
Jun 03 19:36:57.949712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.949162    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.949712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.949309    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:57.949712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.949330    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:57.950986 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.950047    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.950986 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.950581    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.950986 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.950594    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:36:57.951245 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.951224    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.951540 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.951513    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.951654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.951627    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.952004 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.951972    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.952105 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.952034    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:36:57.952171 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.952120    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.952321 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.952290    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config" (OuterVolumeSpecName: "config") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.952458 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.952403    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.952852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.952821    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.953303 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.953275    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.953554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.953525    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:36:57.954056 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.954027    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out" (OuterVolumeSpecName: "config-out") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:36:57.954136 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.954110    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr" (OuterVolumeSpecName: "kube-api-access-9rhxr") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "kube-api-access-9rhxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:36:57.954192 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.954177    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:57.962561 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:57.962539    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config" (OuterVolumeSpecName: "web-config") pod "4ea3a0d1-6efd-44f4-83de-1343ed6cb061" (UID: "4ea3a0d1-6efd-44f4-83de-1343ed6cb061"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:36:58.050594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050553    2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050588    2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-metrics-client-certs\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050602    2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050613    2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-grpc-tls\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050622    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050631    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050640    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-db\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050648    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-metrics-client-ca\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050657    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050665    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050674    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050683    2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-secret-kube-rbac-proxy\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050691    2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-tls-assets\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050698    2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-config-out\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050705    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rhxr\" (UniqueName: \"kubernetes.io/projected/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-kube-api-access-9rhxr\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050713    2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-web-config\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050721    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.050863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.050730    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ea3a0d1-6efd-44f4-83de-1343ed6cb061-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205783    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205813    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205825    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205832    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205837    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205842    2549 generic.go:356] "Generic (PLEG): container finished" podID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39" exitCode=0
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205865    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.205870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205861    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205949    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.205988    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.206012    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.206024    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.206064    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.206106    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"}
Jun 03 19:36:58.206341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.206151    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ea3a0d1-6efd-44f4-83de-1343ed6cb061","Type":"ContainerDied","Data":"f55097acb33e982844a01e347fb743fc2bf8d98affaec3caf8051f38bc4d57ab"}
Jun 03 19:36:58.213812 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.213788    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.220610 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.220589    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.227059 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.227038    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.228663 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.228637    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:58.232248 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.232228    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:58.234318 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.234300    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.240600 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.240581    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.247129 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.247112    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.253483 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.253468    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.253742 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.253721    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.253883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.253751    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.253883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.253789    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.254015 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.253999    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.254048 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254020    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.254048 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254035    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.254244 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.254229    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.254278 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254248    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.254278 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254260    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.254486 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.254467    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.254523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254492    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.254523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254507    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.254721 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.254704    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.254810 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254731    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.254810 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.254744    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.255030 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.255007    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.255160 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255034    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.255160 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255049    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.255335 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:36:58.255318    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.255404 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255337    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.255404 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255357    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.255681 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255656    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.255808 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.255697    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.256118 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256027    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.256118 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256051    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.256429 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256407    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.256429 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256431    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.256672 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256652    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.256751 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256674    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.256912 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256892    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.256988 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256914    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.256988 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.256922    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:58.257141 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257121    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257141    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257167    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="init-config-reloader"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257178    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="init-config-reloader"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257188    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="config-reloader"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257193    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="config-reloader"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257200    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257206    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257213    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="thanos-sidecar"
Jun 03 19:36:58.257213 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257218    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="thanos-sidecar"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257224    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-web"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257233    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-web"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257246    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="prometheus"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257254    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="prometheus"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257263    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-thanos"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257270    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-thanos"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257322    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="config-reloader"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257331    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-thanos"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257337    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="prometheus"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257344    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="thanos-sidecar"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257349    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy-web"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257338    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257369    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.257514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257355    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" containerName="kube-rbac-proxy"
Jun 03 19:36:58.257999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257589    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.257999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257607    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.257999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257878    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.257999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.257894    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.258154 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258136    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.258210 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258157    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.258484 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258383    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.258484 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258421    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.258754 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258729    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.258754 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.258754    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.259052 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259019    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.259128 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259052    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.259299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259280    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.259299 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259300    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.259539 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259518    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.259620 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259539    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.259813 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259791    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.259869 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.259813    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.260036 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260020    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.260087 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260036    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.260230 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260215    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.260275 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260231    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.260455 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260437    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.260501 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260456    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.260638 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260619    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.260704 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260640    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.260891 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260874    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.260943 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.260890    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.261054 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261037    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.261115 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261092    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.261167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261119    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.261500 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261474    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.261604 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261500    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.261804 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261783    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.261804 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.261804    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.262081 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262061    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.262160 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262084    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.262319 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262298    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.262360 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262325    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.262554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262535    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.262554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262554    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.262813 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262795    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.262901 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.262813    2549 scope.go:117] "RemoveContainer" containerID="ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"
Jun 03 19:36:58.263092 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263066    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a"} err="failed to get container status \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": rpc error: code = NotFound desc = could not find container \"ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a\": container with ID starting with ca1983ae631d08139bd8911fb8d3c86dbc3c94d2d0c5c965aa7ed16606cfc37a not found: ID does not exist"
Jun 03 19:36:58.263092 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263092    2549 scope.go:117] "RemoveContainer" containerID="e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"
Jun 03 19:36:58.263285 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263166    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 19:36:58.263285 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263173    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 19:36:58.263382 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263293    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 19:36:58.263429 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263373    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4"} err="failed to get container status \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": rpc error: code = NotFound desc = could not find container \"e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4\": container with ID starting with e135f56588d1c3b0df30be37314457d4e3287fac94d70d90d37dfcf805600ab4 not found: ID does not exist"
Jun 03 19:36:58.263429 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263394    2549 scope.go:117] "RemoveContainer" containerID="8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"
Jun 03 19:36:58.263661 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263634    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14"} err="failed to get container status \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": rpc error: code = NotFound desc = could not find container \"8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14\": container with ID starting with 8facd1bf071dbf3cc00748066a99438fbe94536520af95cd37d9433661f23a14 not found: ID does not exist"
Jun 03 19:36:58.263661 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263660    2549 scope.go:117] "RemoveContainer" containerID="5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"
Jun 03 19:36:58.263818 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263679    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 19:36:58.263818 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263687    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 19:36:58.263945 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263915    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a"} err="failed to get container status \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": rpc error: code = NotFound desc = could not find container \"5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a\": container with ID starting with 5753294f0893570bc6831347e01dedd1951baea5b8e40f492493e4201987e98a not found: ID does not exist"
Jun 03 19:36:58.263945 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.263941    2549 scope.go:117] "RemoveContainer" containerID="03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"
Jun 03 19:36:58.264055 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264019    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 19:36:58.264167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264147    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 19:36:58.264167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264158    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1nruhh4mqjk9o\""
Jun 03 19:36:58.264329 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264158    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303"} err="failed to get container status \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": rpc error: code = NotFound desc = could not find container \"03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303\": container with ID starting with 03b189b4e178199e5d149a2d9648f0bdbf591c72dddc738254e5fa0405a44303 not found: ID does not exist"
Jun 03 19:36:58.264329 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264197    2549 scope.go:117] "RemoveContainer" containerID="6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"
Jun 03 19:36:58.264477 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264454    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39"} err="failed to get container status \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": rpc error: code = NotFound desc = could not find container \"6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39\": container with ID starting with 6cd047b11a0aa1f75a8fa35be7b8a24f800d6c830f1c005d5988ad648bb02a39 not found: ID does not exist"
Jun 03 19:36:58.264477 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264477    2549 scope.go:117] "RemoveContainer" containerID="f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"
Jun 03 19:36:58.264684 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264665    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 19:36:58.264684 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264678    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 19:36:58.264835 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264684    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 19:36:58.264835 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264830    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 19:36:58.264943 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264885    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758"} err="failed to get container status \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": rpc error: code = NotFound desc = could not find container \"f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758\": container with ID starting with f58f027089a46ae86738c40a46a2db81198f97a1722d6fa4c5191b6cba8e8758 not found: ID does not exist"
Jun 03 19:36:58.265003 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.264951    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m97j4\""
Jun 03 19:36:58.265053 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.265020    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 19:36:58.266680 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.266661    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 19:36:58.269081 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.269062    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 19:36:58.282116 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.282090    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:58.353295 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353260    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353303    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353323    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353340    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353366    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353382    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353399    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353445 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353423    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353455    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353471    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353487    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353505    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353520    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353553    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353615    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353637    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353692 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353689    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dxd6\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-kube-api-access-7dxd6\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353987 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353705    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353987 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353727    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.353987 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.353777    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454389 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454332    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454401    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454438    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454464    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454489    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454514    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454534    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454573 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454560    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454592    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454638    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454662    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454689    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454720    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454750    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454802    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454829    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dxd6\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-kube-api-access-7dxd6\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454914    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.454995 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.454953    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.455555 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.455508    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.455668 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.455566    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.456106 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.456049    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.456241 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.456132    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.456448 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.456360    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.457836 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.457805    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458024 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.457999    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458361 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458110    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458361 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458313    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ae22c16-da4e-4bfe-af65-1725665a0939-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458501 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458399    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458712 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458688    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ae22c16-da4e-4bfe-af65-1725665a0939-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458905 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458849    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.458999 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.458976    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.459229 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.459210    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.459439 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.459419    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.459702 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.459682    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-config\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.460346 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.460327    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.460459 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.460443    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.460739 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.460725    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ae22c16-da4e-4bfe-af65-1725665a0939-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.464622 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.464605    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dxd6\" (UniqueName: \"kubernetes.io/projected/3ae22c16-da4e-4bfe-af65-1725665a0939-kube-api-access-7dxd6\") pod \"prometheus-k8s-0\" (UID: \"3ae22c16-da4e-4bfe-af65-1725665a0939\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.574671 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.570807    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:36:58.730710 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.730629    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:36:58.733601 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:36:58.733567    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae22c16_da4e_4bfe_af65_1725665a0939.slice/crio-8027cad1fc35435b5bb0f42aa490c269a3c37ae39ceff0cd56b6de33fc785eb3 WatchSource:0}: Error finding container 8027cad1fc35435b5bb0f42aa490c269a3c37ae39ceff0cd56b6de33fc785eb3: Status 404 returned error can't find the container with id 8027cad1fc35435b5bb0f42aa490c269a3c37ae39ceff0cd56b6de33fc785eb3
Jun 03 19:36:58.829324 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:58.829295    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea3a0d1-6efd-44f4-83de-1343ed6cb061" path="/var/lib/kubelet/pods/4ea3a0d1-6efd-44f4-83de-1343ed6cb061/volumes"
Jun 03 19:36:59.211152 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.211117    2549 generic.go:356] "Generic (PLEG): container finished" podID="3ae22c16-da4e-4bfe-af65-1725665a0939" containerID="72bd14c503bbacf05aed9e0e98a892441fedff8710a84b9fd687ab13eca837cb" exitCode=0
Jun 03 19:36:59.211351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.211192    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerDied","Data":"72bd14c503bbacf05aed9e0e98a892441fedff8710a84b9fd687ab13eca837cb"}
Jun 03 19:36:59.211351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.211253    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"8027cad1fc35435b5bb0f42aa490c269a3c37ae39ceff0cd56b6de33fc785eb3"}
Jun 03 19:36:59.663472 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.663436    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:36:59.665768 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.665743    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3-metrics-certs\") pod \"network-metrics-daemon-nc4kc\" (UID: \"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3\") " pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:36:59.827706 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.827620    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghgxs\""
Jun 03 19:36:59.835462 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.835440    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc4kc"
Jun 03 19:36:59.958034 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.957976    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nc4kc"]
Jun 03 19:36:59.960524 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:36:59.960495    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a545cfe_8b0a_4b04_8e9d_c0c3a920d4a3.slice/crio-1de60ffb776eff9046fe27a298e44e3e6ea9b56ecc84334edb20dd866b2361f9 WatchSource:0}: Error finding container 1de60ffb776eff9046fe27a298e44e3e6ea9b56ecc84334edb20dd866b2361f9: Status 404 returned error can't find the container with id 1de60ffb776eff9046fe27a298e44e3e6ea9b56ecc84334edb20dd866b2361f9
Jun 03 19:36:59.962625 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:36:59.962609    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:37:00.217847 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.217809    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc4kc" event={"ID":"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3","Type":"ContainerStarted","Data":"1de60ffb776eff9046fe27a298e44e3e6ea9b56ecc84334edb20dd866b2361f9"}
Jun 03 19:37:00.221038 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221003    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"48494ee6375886451b664e7753139a63c19c22b5d283fc46e2fc7f4f312c0d82"}
Jun 03 19:37:00.221192 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221073    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"e544741d51d241f1ba6b4987fa50775dbfeffca4eee84d6a8383d93c20ca7331"}
Jun 03 19:37:00.221192 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221111    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"bb4108710c812f357c7442660e3c55956a4dbadb36f603957ff565c36b91b81c"}
Jun 03 19:37:00.221192 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221148    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"26d3185b7d2044a36395d1b62005b12c8583425ea494c906cf31344a33d38bb7"}
Jun 03 19:37:00.221192 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221183    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"4a5ad4ae1f5d5bffe6599a2126b776e3ceba6fc73e5ae8256aa2335b231d15cd"}
Jun 03 19:37:00.221456 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.221219    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ae22c16-da4e-4bfe-af65-1725665a0939","Type":"ContainerStarted","Data":"00c47f21eda228951789bc71207579ec0a5a0bdfbc85fe5161da04f9d66e964e"}
Jun 03 19:37:00.248001 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:00.247938    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.227638672 podStartE2EDuration="2.247917327s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.278655ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:00.24686647 +0000 UTC m=+373.866352724" watchObservedRunningTime="2026-06-03 19:37:00.247917327 +0000 UTC m=+373.867403563"
Jun 03 19:37:01.226974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:01.226873    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc4kc" event={"ID":"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3","Type":"ContainerStarted","Data":"51281c951893ab0bd8fa0d90663af2ec6ebe7b473004d4cbc948aad31f897be4"}
Jun 03 19:37:01.226974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:01.226935    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc4kc" event={"ID":"0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3","Type":"ContainerStarted","Data":"d5744838b8dc174135d086734a86de6c766f29fd0c75b15abf4ddfa10595103c"}
Jun 03 19:37:01.242341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:01.242283    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nc4kc" podStartSLOduration=374.274410375 podStartE2EDuration="6m15.242266247s" totalImagesPullingTime="967.855872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:01.241836172 +0000 UTC m=+374.861322409" watchObservedRunningTime="2026-06-03 19:37:01.242266247 +0000 UTC m=+374.861752472"
Jun 03 19:37:03.573053 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:03.573017    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:37:58.572637 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:58.572550    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:37:58.587706 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:58.587680    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:37:59.449057 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:37:59.449023    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:40:01.712412 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.712375    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"]
Jun 03 19:40:01.715896 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.715873    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.718330 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.718310    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 19:40:01.719401 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.719380    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 03 19:40:01.719523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.719416    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gjrvf\""
Jun 03 19:40:01.719523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.719424    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:40:01.719523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.719421    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 03 19:40:01.719523 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.719385    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 03 19:40:01.724556 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.724534    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"]
Jun 03 19:40:01.740370 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.740339    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/877f722c-3a84-4deb-b3c1-cc3c5c04901f-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.740512 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.740388    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.740512 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.740411    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.740512 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.740505    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx68\" (UniqueName: \"kubernetes.io/projected/877f722c-3a84-4deb-b3c1-cc3c5c04901f-kube-api-access-8vx68\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.840894 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.840850    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx68\" (UniqueName: \"kubernetes.io/projected/877f722c-3a84-4deb-b3c1-cc3c5c04901f-kube-api-access-8vx68\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.841093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.840911    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/877f722c-3a84-4deb-b3c1-cc3c5c04901f-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.841093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.840940    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.841093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.840955    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.841636 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.841609    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/877f722c-3a84-4deb-b3c1-cc3c5c04901f-manager-config\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.843435 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.843412    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.843536 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.843488    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/877f722c-3a84-4deb-b3c1-cc3c5c04901f-metrics-cert\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:01.853510 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:01.853480    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx68\" (UniqueName: \"kubernetes.io/projected/877f722c-3a84-4deb-b3c1-cc3c5c04901f-kube-api-access-8vx68\") pod \"lws-controller-manager-cc8ff6b7b-rm9n2\" (UID: \"877f722c-3a84-4deb-b3c1-cc3c5c04901f\") " pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:02.025438 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:02.025338    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:02.165992 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:02.165957    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"]
Jun 03 19:40:02.169241 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:40:02.169207    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877f722c_3a84_4deb_b3c1_cc3c5c04901f.slice/crio-6837afd828bd3d9994d0b7c2e8ab651960742d6333e1e52bd932156f0f926c51 WatchSource:0}: Error finding container 6837afd828bd3d9994d0b7c2e8ab651960742d6333e1e52bd932156f0f926c51: Status 404 returned error can't find the container with id 6837afd828bd3d9994d0b7c2e8ab651960742d6333e1e52bd932156f0f926c51
Jun 03 19:40:02.872156 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:02.872120    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2" event={"ID":"877f722c-3a84-4deb-b3c1-cc3c5c04901f","Type":"ContainerStarted","Data":"6837afd828bd3d9994d0b7c2e8ab651960742d6333e1e52bd932156f0f926c51"}
Jun 03 19:40:06.889203 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:06.889113    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2" event={"ID":"877f722c-3a84-4deb-b3c1-cc3c5c04901f","Type":"ContainerStarted","Data":"294d9800e7c77af2775d7264b7df82c8ddc1cd4b8a62081c2d75ba791643f78a"}
Jun 03 19:40:06.889607 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:06.889290    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:06.906437 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:06.906387    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2" podStartSLOduration=1.566140249 podStartE2EDuration="5.906371721s" totalImagesPullingTime="4.340231472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:06.90546499 +0000 UTC m=+560.524951227" watchObservedRunningTime="2026-06-03 19:40:06.906371721 +0000 UTC m=+560.525857956"
Jun 03 19:40:10.517122 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.517090    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"]
Jun 03 19:40:10.520187 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.520171    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.523653 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.523628    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 19:40:10.523784 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.523716    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tmlx9\""
Jun 03 19:40:10.523784 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.523727    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 19:40:10.523784 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.523728    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 19:40:10.523935 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.523864    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 19:40:10.548318 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.548289    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"]
Jun 03 19:40:10.613910 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.613876    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.613910 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.613917    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.614138 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.614004    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.614138 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.614046    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.614138 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.614065    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lh5x\" (UniqueName: \"kubernetes.io/projected/c74b2752-1076-4369-9fa1-ff77de219062-kube-api-access-5lh5x\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.714917 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.714879    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.714917 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.714915    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.715164 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.714948    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.715164 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.714971    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.715164 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.714992    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lh5x\" (UniqueName: \"kubernetes.io/projected/c74b2752-1076-4369-9fa1-ff77de219062-kube-api-access-5lh5x\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.715401 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.715378    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-manifests\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.717334 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.717308    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.717812 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.717795    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c74b2752-1076-4369-9fa1-ff77de219062-tmp\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.717867 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.717852    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c74b2752-1076-4369-9fa1-ff77de219062-webhook-cert\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.722882 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.722861    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lh5x\" (UniqueName: \"kubernetes.io/projected/c74b2752-1076-4369-9fa1-ff77de219062-kube-api-access-5lh5x\") pod \"opendatahub-operator-controller-manager-548746c444-2wkwb\" (UID: \"c74b2752-1076-4369-9fa1-ff77de219062\") " pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.829640 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.829564    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:10.965108 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:10.964091    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"]
Jun 03 19:40:10.969510 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:40:10.969095    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74b2752_1076_4369_9fa1_ff77de219062.slice/crio-e010135d5ae955af891b3769d58f9cb807345dc339b1c3d0d74658190e9fb850 WatchSource:0}: Error finding container e010135d5ae955af891b3769d58f9cb807345dc339b1c3d0d74658190e9fb850: Status 404 returned error can't find the container with id e010135d5ae955af891b3769d58f9cb807345dc339b1c3d0d74658190e9fb850
Jun 03 19:40:11.907835 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:11.907788    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb" event={"ID":"c74b2752-1076-4369-9fa1-ff77de219062","Type":"ContainerStarted","Data":"e010135d5ae955af891b3769d58f9cb807345dc339b1c3d0d74658190e9fb850"}
Jun 03 19:40:13.917779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:13.917726    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb" event={"ID":"c74b2752-1076-4369-9fa1-ff77de219062","Type":"ContainerStarted","Data":"69745825cc3c35b158cbc852738a755fa8a40e142894614876a992070c8adb60"}
Jun 03 19:40:14.923126 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:14.923090    2549 generic.go:356] "Generic (PLEG): container finished" podID="c74b2752-1076-4369-9fa1-ff77de219062" containerID="69745825cc3c35b158cbc852738a755fa8a40e142894614876a992070c8adb60" exitCode=0
Jun 03 19:40:14.923555 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:14.923177    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb" event={"ID":"c74b2752-1076-4369-9fa1-ff77de219062","Type":"ContainerDied","Data":"69745825cc3c35b158cbc852738a755fa8a40e142894614876a992070c8adb60"}
Jun 03 19:40:15.929411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:15.929373    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb" event={"ID":"c74b2752-1076-4369-9fa1-ff77de219062","Type":"ContainerStarted","Data":"4e31ff63c231f5b9d84d22dbf3e5054a390edc82b4a285e88adc02b6d10ccd1f"}
Jun 03 19:40:15.929854 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:15.929469    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:15.950211 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:15.950158    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb" podStartSLOduration=1.834921042 podStartE2EDuration="5.95013877s" totalImagesPullingTime="3.142349116s" totalInitContainerRuntime="972.868612ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:15.948264059 +0000 UTC m=+569.567750294" watchObservedRunningTime="2026-06-03 19:40:15.95013877 +0000 UTC m=+569.569625007"
Jun 03 19:40:17.895404 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:17.895369    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cc8ff6b7b-rm9n2"
Jun 03 19:40:26.935839 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:26.935808    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-548746c444-2wkwb"
Jun 03 19:40:29.439541 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.439509    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"]
Jun 03 19:40:29.540998 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.540968    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"]
Jun 03 19:40:29.541167 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.541077    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.543413 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.543392    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 19:40:29.543524 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.543436    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 19:40:29.544266 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.544246    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q7tgt\""
Jun 03 19:40:29.544357 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.544271    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 19:40:29.544357 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.544351    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 19:40:29.684575 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.684539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cg7x\" (UniqueName: \"kubernetes.io/projected/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-kube-api-access-6cg7x\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.684772 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.684600    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tls-certs\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.684772 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.684618    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tmp\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.786038 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.785942    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tmp\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.786038 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.786034    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cg7x\" (UniqueName: \"kubernetes.io/projected/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-kube-api-access-6cg7x\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.786255 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.786103    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tls-certs\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.788128 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.788102    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tmp\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.788393 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.788374    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-tls-certs\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.795577 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.795550    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cg7x\" (UniqueName: \"kubernetes.io/projected/f319f62d-5ccf-4664-bda7-4c3e7f415dcd-kube-api-access-6cg7x\") pod \"kube-auth-proxy-89c854d9f-p2f6f\" (UID: \"f319f62d-5ccf-4664-bda7-4c3e7f415dcd\") " pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.850714 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.850680    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"
Jun 03 19:40:29.997411 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:29.997385    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f"]
Jun 03 19:40:30.000004 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:40:29.999977    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf319f62d_5ccf_4664_bda7_4c3e7f415dcd.slice/crio-33cb6cd32b64dbeeb156c7a9ab69b339f245d94632782fe289fbd10541e33164 WatchSource:0}: Error finding container 33cb6cd32b64dbeeb156c7a9ab69b339f245d94632782fe289fbd10541e33164: Status 404 returned error can't find the container with id 33cb6cd32b64dbeeb156c7a9ab69b339f245d94632782fe289fbd10541e33164
Jun 03 19:40:30.991559 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:30.991521    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f" event={"ID":"f319f62d-5ccf-4664-bda7-4c3e7f415dcd","Type":"ContainerStarted","Data":"33cb6cd32b64dbeeb156c7a9ab69b339f245d94632782fe289fbd10541e33164"}
Jun 03 19:40:33.001777 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:33.001731    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f" event={"ID":"f319f62d-5ccf-4664-bda7-4c3e7f415dcd","Type":"ContainerStarted","Data":"8cee3cb543bfb9bc422c675edf499c62b7c34898e91cce3f1589f192213dfd5f"}
Jun 03 19:40:46.813492 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:46.813461    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:40:46.813950 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:40:46.813525    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:42:16.352544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.352486    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-89c854d9f-p2f6f" podStartSLOduration=104.756043923 podStartE2EDuration="1m47.352465502s" totalImagesPullingTime="2.596421579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:33.016289645 +0000 UTC m=+586.635775880" watchObservedRunningTime="2026-06-03 19:42:16.352465502 +0000 UTC m=+689.971951738"
Jun 03 19:42:16.354234 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.354206    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"]
Jun 03 19:42:16.356292 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.356275    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.358650 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.358626    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 19:42:16.358737 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.358628    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 03 19:42:16.358737 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.358667    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgwg5\""
Jun 03 19:42:16.359377 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.359357    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 19:42:16.359464 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.359362    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 03 19:42:16.364272 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.364247    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"]
Jun 03 19:42:16.407974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.407938    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmll7\" (UniqueName: \"kubernetes.io/projected/75d547a1-3d07-41c3-8668-ce293f5b3698-kube-api-access-dmll7\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.407974 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.407980    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d547a1-3d07-41c3-8668-ce293f5b3698-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.408181 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.408042    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.509235 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.509192    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmll7\" (UniqueName: \"kubernetes.io/projected/75d547a1-3d07-41c3-8668-ce293f5b3698-kube-api-access-dmll7\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.509398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.509248    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d547a1-3d07-41c3-8668-ce293f5b3698-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.509398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.509293    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.509475 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:42:16.509429    2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jun 03 19:42:16.509517 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:42:16.509506    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert podName:75d547a1-3d07-41c3-8668-ce293f5b3698 nodeName:}" failed. No retries permitted until 2026-06-03 19:42:17.00948559 +0000 UTC m=+690.628971803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-q2r98" (UID: "75d547a1-3d07-41c3-8668-ce293f5b3698") : secret "plugin-serving-cert" not found
Jun 03 19:42:16.510053 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.510032    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d547a1-3d07-41c3-8668-ce293f5b3698-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:16.517436 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:16.517412    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmll7\" (UniqueName: \"kubernetes.io/projected/75d547a1-3d07-41c3-8668-ce293f5b3698-kube-api-access-dmll7\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:17.013715 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:17.013680    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:17.016077 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:17.016054    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/75d547a1-3d07-41c3-8668-ce293f5b3698-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-q2r98\" (UID: \"75d547a1-3d07-41c3-8668-ce293f5b3698\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:17.265702 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:17.265611    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"
Jun 03 19:42:17.403913 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:17.403881    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98"]
Jun 03 19:42:17.406876 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:42:17.406850    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75d547a1_3d07_41c3_8668_ce293f5b3698.slice/crio-02f4d97d25c710e8e3c8e43d24d90b1b00cab14c78fdb6476cd1db2c9352b2dc WatchSource:0}: Error finding container 02f4d97d25c710e8e3c8e43d24d90b1b00cab14c78fdb6476cd1db2c9352b2dc: Status 404 returned error can't find the container with id 02f4d97d25c710e8e3c8e43d24d90b1b00cab14c78fdb6476cd1db2c9352b2dc
Jun 03 19:42:17.408200 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:17.408183    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:42:18.401506 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:18.401464    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98" event={"ID":"75d547a1-3d07-41c3-8668-ce293f5b3698","Type":"ContainerStarted","Data":"02f4d97d25c710e8e3c8e43d24d90b1b00cab14c78fdb6476cd1db2c9352b2dc"}
Jun 03 19:42:41.509120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:41.509090    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98" event={"ID":"75d547a1-3d07-41c3-8668-ce293f5b3698","Type":"ContainerStarted","Data":"2823a6c820a133fc4c5f88159a42396ae3b70b2d41b3806b5149ce4aa168905f"}
Jun 03 19:42:42.528704 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:42:42.528623    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-q2r98" podStartSLOduration=2.564660549 podStartE2EDuration="26.528607705s" totalImagesPullingTime="23.963947156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:42.527952781 +0000 UTC m=+716.147439016" watchObservedRunningTime="2026-06-03 19:42:42.528607705 +0000 UTC m=+716.148093938"
Jun 03 19:43:05.200491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.200426    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:43:05.202983 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.202961    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.205494 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.205475    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 19:43:05.214619 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.214593    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:43:05.230800 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.230744    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86hqg\" (UniqueName: \"kubernetes.io/projected/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-kube-api-access-86hqg\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.230939 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.230879    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-config-file\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.250040 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.250011    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:43:05.331782 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.331724    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86hqg\" (UniqueName: \"kubernetes.io/projected/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-kube-api-access-86hqg\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.331924 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.331849    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-config-file\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.332514 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.332493    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-config-file\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.339431 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.339406    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86hqg\" (UniqueName: \"kubernetes.io/projected/5fc879e5-8ae7-4e40-b97a-4f5a015d596c-kube-api-access-86hqg\") pod \"limitador-limitador-54d6d988d5-7mzs9\" (UID: \"5fc879e5-8ae7-4e40-b97a-4f5a015d596c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.512863 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.512742    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:05.639078 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.639051    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:43:05.641323 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:43:05.641285    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc879e5_8ae7_4e40_b97a_4f5a015d596c.slice/crio-fbd031cd0249f2830e5e0476802810c0dc642b85fe0a6f07cf2ae96a86492f26 WatchSource:0}: Error finding container fbd031cd0249f2830e5e0476802810c0dc642b85fe0a6f07cf2ae96a86492f26: Status 404 returned error can't find the container with id fbd031cd0249f2830e5e0476802810c0dc642b85fe0a6f07cf2ae96a86492f26
Jun 03 19:43:05.839988 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.839914    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:43:05.843191 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.843173    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:43:05.845742 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.845721    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mrjgz\""
Jun 03 19:43:05.849845 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.849825    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:43:05.938567 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:05.938533    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqp9\" (UniqueName: \"kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9\") pod \"authorino-75d556bd77-4svbs\" (UID: \"c5e1cdb7-5cf7-4305-af0f-466075692392\") " pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:43:06.039612 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.039577    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqp9\" (UniqueName: \"kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9\") pod \"authorino-75d556bd77-4svbs\" (UID: \"c5e1cdb7-5cf7-4305-af0f-466075692392\") " pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:43:06.048232 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.048200    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqp9\" (UniqueName: \"kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9\") pod \"authorino-75d556bd77-4svbs\" (UID: \"c5e1cdb7-5cf7-4305-af0f-466075692392\") " pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:43:06.153807 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.153606    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:43:06.327617 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.327552    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:43:06.330083 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:43:06.330047    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e1cdb7_5cf7_4305_af0f_466075692392.slice/crio-1005a7b7b60b6d913da7aa9eaf9800daf85ee736cb40ec29fe8196a958d4a74e WatchSource:0}: Error finding container 1005a7b7b60b6d913da7aa9eaf9800daf85ee736cb40ec29fe8196a958d4a74e: Status 404 returned error can't find the container with id 1005a7b7b60b6d913da7aa9eaf9800daf85ee736cb40ec29fe8196a958d4a74e
Jun 03 19:43:06.615565 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.615496    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4svbs" event={"ID":"c5e1cdb7-5cf7-4305-af0f-466075692392","Type":"ContainerStarted","Data":"1005a7b7b60b6d913da7aa9eaf9800daf85ee736cb40ec29fe8196a958d4a74e"}
Jun 03 19:43:06.616883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:06.616851    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9" event={"ID":"5fc879e5-8ae7-4e40-b97a-4f5a015d596c","Type":"ContainerStarted","Data":"fbd031cd0249f2830e5e0476802810c0dc642b85fe0a6f07cf2ae96a86492f26"}
Jun 03 19:43:11.646532 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:11.646492    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9" event={"ID":"5fc879e5-8ae7-4e40-b97a-4f5a015d596c","Type":"ContainerStarted","Data":"6006ce743ce71acc7761a380eae59f7d0dc2ca024575d053c4fb9d56b0c680fc"}
Jun 03 19:43:11.646997 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:11.646557    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:43:11.647941 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:11.647918    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4svbs" event={"ID":"c5e1cdb7-5cf7-4305-af0f-466075692392","Type":"ContainerStarted","Data":"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"}
Jun 03 19:43:11.662993 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:11.662940    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9" podStartSLOduration=1.384680694 podStartE2EDuration="6.662923515s" totalImagesPullingTime="5.278242821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.661784076 +0000 UTC m=+745.281270311" watchObservedRunningTime="2026-06-03 19:43:11.662923515 +0000 UTC m=+745.282409755"
Jun 03 19:43:11.675611 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:11.675575    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4svbs" podStartSLOduration=2.085173904 podStartE2EDuration="6.675563196s" totalImagesPullingTime="4.590389292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.674358282 +0000 UTC m=+745.293844518" watchObservedRunningTime="2026-06-03 19:43:11.675563196 +0000 UTC m=+745.295049480"
Jun 03 19:43:22.653554 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:43:22.653525    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"
Jun 03 19:44:01.386387 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.386297    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:44:01.388962 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.388939    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:01.391646 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.391622    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bpsn5\""
Jun 03 19:44:01.391791 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.391666    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 19:44:01.392294 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.392278    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 19:44:01.392373 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.392313    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 19:44:01.410145 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.410120    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:44:01.416985 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.416957    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh72r\" (UniqueName: \"kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r\") pod \"maas-keycloak-0\" (UID: \"ed8f7e3b-e9ba-4777-96ce-739a066978cf\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:01.517623 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.517566    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh72r\" (UniqueName: \"kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r\") pod \"maas-keycloak-0\" (UID: \"ed8f7e3b-e9ba-4777-96ce-739a066978cf\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:01.525799 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.525772    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh72r\" (UniqueName: \"kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r\") pod \"maas-keycloak-0\" (UID: \"ed8f7e3b-e9ba-4777-96ce-739a066978cf\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:01.698337 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.698294    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:01.825539 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.825514    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:44:01.828095 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:44:01.828061    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8f7e3b_e9ba_4777_96ce_739a066978cf.slice/crio-60f1e9c6c96232293c586bae543613211dd0d45d1bd0fd9c09d16137cc066e8d WatchSource:0}: Error finding container 60f1e9c6c96232293c586bae543613211dd0d45d1bd0fd9c09d16137cc066e8d: Status 404 returned error can't find the container with id 60f1e9c6c96232293c586bae543613211dd0d45d1bd0fd9c09d16137cc066e8d
Jun 03 19:44:01.848851 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:01.848822    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ed8f7e3b-e9ba-4777-96ce-739a066978cf","Type":"ContainerStarted","Data":"60f1e9c6c96232293c586bae543613211dd0d45d1bd0fd9c09d16137cc066e8d"}
Jun 03 19:44:07.881228 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:07.881192    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ed8f7e3b-e9ba-4777-96ce-739a066978cf","Type":"ContainerStarted","Data":"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"}
Jun 03 19:44:07.899173 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:07.899118    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.992350985 podStartE2EDuration="6.899103342s" totalImagesPullingTime="5.906752357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:07.898856713 +0000 UTC m=+801.518342976" watchObservedRunningTime="2026-06-03 19:44:07.899103342 +0000 UTC m=+801.518589577"
Jun 03 19:44:08.699349 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:08.699306    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:08.700902 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:08.700864    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:09.699002 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:09.698947    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:10.699353 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:10.699308    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:11.698717 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:11.698663    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:11.699118 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:11.699083    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:12.699857 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:12.699805    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:13.699630 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:13.699573    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:14.699235 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:14.699177    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:15.699499 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:15.699447    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:16.699061 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:16.699012    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:17.699606 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:17.699556    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:18.699012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:18.698963    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:19.699116 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:19.699068    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:20.699586 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:20.699535    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.23:9000/health/started\": dial tcp 10.134.0.23:9000: connect: connection refused"
Jun 03 19:44:21.793795 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:21.793732    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:21.809895 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:21.809842    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:44:31.799455 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:31.799419    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:44:34.594151 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:34.594117    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:44:34.594633 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:34.594296    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4svbs" podUID="c5e1cdb7-5cf7-4305-af0f-466075692392" containerName="authorino" containerID="cri-o://b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd" gracePeriod=30
Jun 03 19:44:34.849406 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:34.849353    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:44:34.938006 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:34.937971    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjqp9\" (UniqueName: \"kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9\") pod \"c5e1cdb7-5cf7-4305-af0f-466075692392\" (UID: \"c5e1cdb7-5cf7-4305-af0f-466075692392\") "
Jun 03 19:44:34.940159 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:34.940126    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9" (OuterVolumeSpecName: "kube-api-access-fjqp9") pod "c5e1cdb7-5cf7-4305-af0f-466075692392" (UID: "c5e1cdb7-5cf7-4305-af0f-466075692392"). InnerVolumeSpecName "kube-api-access-fjqp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:44:35.023820 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.023784    2549 generic.go:356] "Generic (PLEG): container finished" podID="c5e1cdb7-5cf7-4305-af0f-466075692392" containerID="b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd" exitCode=0
Jun 03 19:44:35.023978 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.023827    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4svbs"
Jun 03 19:44:35.023978 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.023850    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4svbs" event={"ID":"c5e1cdb7-5cf7-4305-af0f-466075692392","Type":"ContainerDied","Data":"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"}
Jun 03 19:44:35.023978 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.023880    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4svbs" event={"ID":"c5e1cdb7-5cf7-4305-af0f-466075692392","Type":"ContainerDied","Data":"1005a7b7b60b6d913da7aa9eaf9800daf85ee736cb40ec29fe8196a958d4a74e"}
Jun 03 19:44:35.023978 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.023896    2549 scope.go:117] "RemoveContainer" containerID="b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"
Jun 03 19:44:35.032349 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.032328    2549 scope.go:117] "RemoveContainer" containerID="b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"
Jun 03 19:44:35.032596 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:44:35.032574    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd\": container with ID starting with b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd not found: ID does not exist" containerID="b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"
Jun 03 19:44:35.032665 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.032602    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd"} err="failed to get container status \"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd\": rpc error: code = NotFound desc = could not find container \"b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd\": container with ID starting with b7336706fa0931b050342fcbe4e3e37a98556a120047527b4e7f02f7666ac3fd not found: ID does not exist"
Jun 03 19:44:35.039403 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.039381    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjqp9\" (UniqueName: \"kubernetes.io/projected/c5e1cdb7-5cf7-4305-af0f-466075692392-kube-api-access-fjqp9\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:44:35.047120 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.047091    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:44:35.051397 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:35.051375    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4svbs"]
Jun 03 19:44:36.830810 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:36.830778    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5e1cdb7-5cf7-4305-af0f-466075692392" path="/var/lib/kubelet/pods/c5e1cdb7-5cf7-4305-af0f-466075692392/volumes"
Jun 03 19:44:37.618280 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.618246    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:37.618569 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.618544    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e1cdb7-5cf7-4305-af0f-466075692392" containerName="authorino"
Jun 03 19:44:37.618616 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.618571    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e1cdb7-5cf7-4305-af0f-466075692392" containerName="authorino"
Jun 03 19:44:37.618650 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.618642    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e1cdb7-5cf7-4305-af0f-466075692392" containerName="authorino"
Jun 03 19:44:37.621012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.620994    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:37.626495 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.626464    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 19:44:37.626640 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.626505    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bcblb\""
Jun 03 19:44:37.644036 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.644007    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:37.660644 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.660617    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98684\" (UniqueName: \"kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684\") pod \"maas-controller-d6d6c9ffc-krs5g\" (UID: \"04bfede6-3672-4ae8-851d-03593f6ad8d1\") " pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:37.761275 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.761240    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98684\" (UniqueName: \"kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684\") pod \"maas-controller-d6d6c9ffc-krs5g\" (UID: \"04bfede6-3672-4ae8-851d-03593f6ad8d1\") " pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:37.768816 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.768783    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98684\" (UniqueName: \"kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684\") pod \"maas-controller-d6d6c9ffc-krs5g\" (UID: \"04bfede6-3672-4ae8-851d-03593f6ad8d1\") " pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:37.931375 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:37.931343    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:38.058857 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:38.058824    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:38.061688 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:44:38.061659    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bfede6_3672_4ae8_851d_03593f6ad8d1.slice/crio-7964a981b1776bcf90cb35155da795a9f25649ab4a103472d9a3bebbc2536924 WatchSource:0}: Error finding container 7964a981b1776bcf90cb35155da795a9f25649ab4a103472d9a3bebbc2536924: Status 404 returned error can't find the container with id 7964a981b1776bcf90cb35155da795a9f25649ab4a103472d9a3bebbc2536924
Jun 03 19:44:39.043535 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:39.043494    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" event={"ID":"04bfede6-3672-4ae8-851d-03593f6ad8d1","Type":"ContainerStarted","Data":"7964a981b1776bcf90cb35155da795a9f25649ab4a103472d9a3bebbc2536924"}
Jun 03 19:44:41.054318 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:41.054284    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" event={"ID":"04bfede6-3672-4ae8-851d-03593f6ad8d1","Type":"ContainerStarted","Data":"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"}
Jun 03 19:44:41.054870 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:41.054349    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:41.070847 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:41.070803    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" podStartSLOduration=1.7423124429999999 podStartE2EDuration="4.070788811s" totalImagesPullingTime="2.328476368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:41.069696473 +0000 UTC m=+834.689182708" watchObservedRunningTime="2026-06-03 19:44:41.070788811 +0000 UTC m=+834.690275046"
Jun 03 19:44:52.064248 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.064218    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:52.072629 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.072596    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:52.098904 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.098846    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" podUID="04bfede6-3672-4ae8-851d-03593f6ad8d1" containerName="manager" containerID="cri-o://3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18" gracePeriod=30
Jun 03 19:44:52.340229 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.340201    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:52.400695 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.400661    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98684\" (UniqueName: \"kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684\") pod \"04bfede6-3672-4ae8-851d-03593f6ad8d1\" (UID: \"04bfede6-3672-4ae8-851d-03593f6ad8d1\") "
Jun 03 19:44:52.402935 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.402909    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684" (OuterVolumeSpecName: "kube-api-access-98684") pod "04bfede6-3672-4ae8-851d-03593f6ad8d1" (UID: "04bfede6-3672-4ae8-851d-03593f6ad8d1"). InnerVolumeSpecName "kube-api-access-98684". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:44:52.501310 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:52.501281    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98684\" (UniqueName: \"kubernetes.io/projected/04bfede6-3672-4ae8-851d-03593f6ad8d1-kube-api-access-98684\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:44:53.104398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.104314    2549 generic.go:356] "Generic (PLEG): container finished" podID="04bfede6-3672-4ae8-851d-03593f6ad8d1" containerID="3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18" exitCode=0
Jun 03 19:44:53.104398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.104361    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g"
Jun 03 19:44:53.104398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.104375    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" event={"ID":"04bfede6-3672-4ae8-851d-03593f6ad8d1","Type":"ContainerDied","Data":"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"}
Jun 03 19:44:53.104928 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.104426    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d6c9ffc-krs5g" event={"ID":"04bfede6-3672-4ae8-851d-03593f6ad8d1","Type":"ContainerDied","Data":"7964a981b1776bcf90cb35155da795a9f25649ab4a103472d9a3bebbc2536924"}
Jun 03 19:44:53.104928 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.104456    2549 scope.go:117] "RemoveContainer" containerID="3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"
Jun 03 19:44:53.112547 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.112528    2549 scope.go:117] "RemoveContainer" containerID="3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"
Jun 03 19:44:53.112808 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:44:53.112791    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18\": container with ID starting with 3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18 not found: ID does not exist" containerID="3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"
Jun 03 19:44:53.112865 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.112815    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18"} err="failed to get container status \"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18\": rpc error: code = NotFound desc = could not find container \"3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18\": container with ID starting with 3da104c27886600d169823430de64244e60daebe79f09e3605b60cfa9d314d18 not found: ID does not exist"
Jun 03 19:44:53.120061 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.120033    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:53.124357 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:53.124334    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d6d6c9ffc-krs5g"]
Jun 03 19:44:54.830418 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:44:54.830384    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04bfede6-3672-4ae8-851d-03593f6ad8d1" path="/var/lib/kubelet/pods/04bfede6-3672-4ae8-851d-03593f6ad8d1/volumes"
Jun 03 19:45:11.313658 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:11.313619    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:45:22.893114 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:22.893080    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:22.893521 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:22.893263    2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak" containerID="cri-o://52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323" gracePeriod=30
Jun 03 19:45:24.935654 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:24.935628    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:24.986492 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:24.986404    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh72r\" (UniqueName: \"kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r\") pod \"ed8f7e3b-e9ba-4777-96ce-739a066978cf\" (UID: \"ed8f7e3b-e9ba-4777-96ce-739a066978cf\") "
Jun 03 19:45:24.988468 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:24.988443    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r" (OuterVolumeSpecName: "kube-api-access-bh72r") pod "ed8f7e3b-e9ba-4777-96ce-739a066978cf" (UID: "ed8f7e3b-e9ba-4777-96ce-739a066978cf"). InnerVolumeSpecName "kube-api-access-bh72r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:45:25.087291 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.087256    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh72r\" (UniqueName: \"kubernetes.io/projected/ed8f7e3b-e9ba-4777-96ce-739a066978cf-kube-api-access-bh72r\") on node \"ip-10-0-128-21.ec2.internal\" DevicePath \"\""
Jun 03 19:45:25.243711 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.243615    2549 generic.go:356] "Generic (PLEG): container finished" podID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerID="52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323" exitCode=143
Jun 03 19:45:25.243711 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.243690    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ed8f7e3b-e9ba-4777-96ce-739a066978cf","Type":"ContainerDied","Data":"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"}
Jun 03 19:45:25.243967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.243798    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ed8f7e3b-e9ba-4777-96ce-739a066978cf","Type":"ContainerDied","Data":"60f1e9c6c96232293c586bae543613211dd0d45d1bd0fd9c09d16137cc066e8d"}
Jun 03 19:45:25.243967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.243835    2549 scope.go:117] "RemoveContainer" containerID="52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"
Jun 03 19:45:25.243967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.243865    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.253431 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.253411    2549 scope.go:117] "RemoveContainer" containerID="52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"
Jun 03 19:45:25.253687 ip-10-0-128-21 kubenswrapper[2549]: E0603 19:45:25.253667    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323\": container with ID starting with 52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323 not found: ID does not exist" containerID="52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"
Jun 03 19:45:25.253738 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.253695    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323"} err="failed to get container status \"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323\": rpc error: code = NotFound desc = could not find container \"52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323\": container with ID starting with 52d2307ace6fe1aa8df139c2968e410fadf816b554d92076ff727c617aee1323 not found: ID does not exist"
Jun 03 19:45:25.264500 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.264473    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:25.268015 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.267994    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:25.289672 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.289640    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:25.289959 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.289945    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak"
Jun 03 19:45:25.290005 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.289961    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak"
Jun 03 19:45:25.290005 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.289979    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04bfede6-3672-4ae8-851d-03593f6ad8d1" containerName="manager"
Jun 03 19:45:25.290005 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.289986    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="04bfede6-3672-4ae8-851d-03593f6ad8d1" containerName="manager"
Jun 03 19:45:25.290097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.290035    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="04bfede6-3672-4ae8-851d-03593f6ad8d1" containerName="manager"
Jun 03 19:45:25.290097 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.290045    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" containerName="keycloak"
Jun 03 19:45:25.292527 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.292508    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.294826 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.294799    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 19:45:25.294938 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.294921    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 03 19:45:25.294993 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.294964    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 19:45:25.295046 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.295015    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bpsn5\""
Jun 03 19:45:25.295106 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.295050    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 19:45:25.304278 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.304253    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:25.390178 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.390132    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.390362 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.390200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfchm\" (UniqueName: \"kubernetes.io/projected/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-kube-api-access-hfchm\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.490970 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.490936    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.491118 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.490989    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfchm\" (UniqueName: \"kubernetes.io/projected/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-kube-api-access-hfchm\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.491655 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.491633    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-test-realms\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.498666 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.498612    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfchm\" (UniqueName: \"kubernetes.io/projected/c8081e68-36de-4b24-a0d2-f31a9baf6d8a-kube-api-access-hfchm\") pod \"maas-keycloak-0\" (UID: \"c8081e68-36de-4b24-a0d2-f31a9baf6d8a\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.608186 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.608146    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:25.735929 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:25.735905    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:45:25.738135 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:45:25.738104    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8081e68_36de_4b24_a0d2_f31a9baf6d8a.slice/crio-cc7fc535d8dcef6e3479ab3e13a97abab61c84e8ed527ae18d9323a14f9e5730 WatchSource:0}: Error finding container cc7fc535d8dcef6e3479ab3e13a97abab61c84e8ed527ae18d9323a14f9e5730: Status 404 returned error can't find the container with id cc7fc535d8dcef6e3479ab3e13a97abab61c84e8ed527ae18d9323a14f9e5730
Jun 03 19:45:26.252012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.251938    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8081e68-36de-4b24-a0d2-f31a9baf6d8a","Type":"ContainerStarted","Data":"da5a03b6bdb1cb08b75ab7409e41d19b69e404b5c3f2d5bbef70eca030876fbf"}
Jun 03 19:45:26.252012 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.252007    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8081e68-36de-4b24-a0d2-f31a9baf6d8a","Type":"ContainerStarted","Data":"cc7fc535d8dcef6e3479ab3e13a97abab61c84e8ed527ae18d9323a14f9e5730"}
Jun 03 19:45:26.268742 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.268691    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.960069438 podStartE2EDuration="1.268675165s" totalImagesPullingTime="308.605727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:45:26.267293869 +0000 UTC m=+879.886780117" watchObservedRunningTime="2026-06-03 19:45:26.268675165 +0000 UTC m=+879.888161400"
Jun 03 19:45:26.609313 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.609266    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:26.610940 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.610903    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:26.831939 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:26.831907    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8f7e3b-e9ba-4777-96ce-739a066978cf" path="/var/lib/kubelet/pods/ed8f7e3b-e9ba-4777-96ce-739a066978cf/volumes"
Jun 03 19:45:27.609686 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:27.609622    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:28.608778 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:28.608719    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:29.609421 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:29.609366    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:30.608950 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:30.608893    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:31.609550 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:31.609498    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:32.610015 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:32.609558    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:33.609397 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:33.609354    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:34.609298 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:34.609244    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:35.609822 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:35.609068    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:35.609822 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:35.609408    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:36.608629 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:36.608570    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:37.609534 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:37.609481    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:38.609486 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:38.609443    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused"
Jun 03 19:45:39.737089 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:39.737047    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:45:39.758317 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:39.758264    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c8081e68-36de-4b24-a0d2-f31a9baf6d8a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:45:46.858065 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:46.858037    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:45:46.858478 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:46.858229    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:45:49.745317 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:45:49.745278    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:46:21.820039 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.820007    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"]
Jun 03 19:46:21.823453 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.823436    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.826853 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.826812    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 19:46:21.826971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.826821    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ctq9\""
Jun 03 19:46:21.826971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.826876    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 19:46:21.826971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.826822    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 19:46:21.832838 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.832817    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"]
Jun 03 19:46:21.900971 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.900937    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.901137 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.900985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.901137 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.901043    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/806384ce-1fdc-4661-93cf-8f8670ff0fd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.901137 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.901080    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qc6r\" (UniqueName: \"kubernetes.io/projected/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kube-api-access-7qc6r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.901137 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.901120    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:21.901282 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:21.901140    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002340 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002300    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qc6r\" (UniqueName: \"kubernetes.io/projected/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kube-api-access-7qc6r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002526 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002361    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002526 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002381    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002526 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002410    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002526 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002430    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002526 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002471    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/806384ce-1fdc-4661-93cf-8f8670ff0fd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002963 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002933    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.002963 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002954    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.003088 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.002964    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.004702 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.004685    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/806384ce-1fdc-4661-93cf-8f8670ff0fd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.005056 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.005036    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/806384ce-1fdc-4661-93cf-8f8670ff0fd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.010806 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.010785    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qc6r\" (UniqueName: \"kubernetes.io/projected/806384ce-1fdc-4661-93cf-8f8670ff0fd6-kube-api-access-7qc6r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg\" (UID: \"806384ce-1fdc-4661-93cf-8f8670ff0fd6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.134329 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.134237    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:22.264047 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.264022    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"]
Jun 03 19:46:22.266574 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:46:22.266540    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806384ce_1fdc_4661_93cf_8f8670ff0fd6.slice/crio-d884efa5c7f59dd8cf9fc1162e958dcc578bef5e5b1d73f604aba097f0e42aa8 WatchSource:0}: Error finding container d884efa5c7f59dd8cf9fc1162e958dcc578bef5e5b1d73f604aba097f0e42aa8: Status 404 returned error can't find the container with id d884efa5c7f59dd8cf9fc1162e958dcc578bef5e5b1d73f604aba097f0e42aa8
Jun 03 19:46:22.295004 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.294972    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:46:22.511592 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:22.511558    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg" event={"ID":"806384ce-1fdc-4661-93cf-8f8670ff0fd6","Type":"ContainerStarted","Data":"d884efa5c7f59dd8cf9fc1162e958dcc578bef5e5b1d73f604aba097f0e42aa8"}
Jun 03 19:46:26.531691 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:26.531654    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg" event={"ID":"806384ce-1fdc-4661-93cf-8f8670ff0fd6","Type":"ContainerStarted","Data":"f6e128909a4633217f1d07da31c5102e1ce498f19f936851f8febc12717d5e6a"}
Jun 03 19:46:27.537021 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:27.536983    2549 generic.go:356] "Generic (PLEG): container finished" podID="806384ce-1fdc-4661-93cf-8f8670ff0fd6" containerID="f6e128909a4633217f1d07da31c5102e1ce498f19f936851f8febc12717d5e6a" exitCode=0
Jun 03 19:46:27.537496 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:27.537037    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg" event={"ID":"806384ce-1fdc-4661-93cf-8f8670ff0fd6","Type":"ContainerDied","Data":"f6e128909a4633217f1d07da31c5102e1ce498f19f936851f8febc12717d5e6a"}
Jun 03 19:46:29.547831 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:29.547791    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg" event={"ID":"806384ce-1fdc-4661-93cf-8f8670ff0fd6","Type":"ContainerStarted","Data":"56a3b11c67d73ac61275affcc8f77bb1424e187b7d8cc55c4a98b6c1bf186ae4"}
Jun 03 19:46:29.565769 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:29.565708    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg" podStartSLOduration=2.430521827 podStartE2EDuration="8.565692713s" totalImagesPullingTime="4.803644682s" totalInitContainerRuntime="1.331526204s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:29.563616126 +0000 UTC m=+943.183102352" watchObservedRunningTime="2026-06-03 19:46:29.565692713 +0000 UTC m=+943.185178948"
Jun 03 19:46:32.135068 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:32.135031    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:32.135465 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:32.135174    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:32.147967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:32.147939    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:32.572941 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:32.572907    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg"
Jun 03 19:46:40.886491 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:40.886460    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:46:48.594949 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:48.594916    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:46:59.807595 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.807513    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"]
Jun 03 19:46:59.810422 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.810405    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.812594 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.812576    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 03 19:46:59.821729 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.821706    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"]
Jun 03 19:46:59.834406 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834381    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.834562 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.834562 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834434    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28sn\" (UniqueName: \"kubernetes.io/projected/52fcf85c-1338-4eed-8321-b8258342a1cf-kube-api-access-c28sn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.834562 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52fcf85c-1338-4eed-8321-b8258342a1cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.834680 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834572    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.834680 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.834624    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.935748 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935706    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.935748 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935745    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.935748 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935780    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28sn\" (UniqueName: \"kubernetes.io/projected/52fcf85c-1338-4eed-8321-b8258342a1cf-kube-api-access-c28sn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935880    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52fcf85c-1338-4eed-8321-b8258342a1cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935938    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936093 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.935987    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936257 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.936207    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936376 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.936310    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.936436 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.936383    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.938079 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.938061    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52fcf85c-1338-4eed-8321-b8258342a1cf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.938403 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.938385    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52fcf85c-1338-4eed-8321-b8258342a1cf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:46:59.942847 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:46:59.942821    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28sn\" (UniqueName: \"kubernetes.io/projected/52fcf85c-1338-4eed-8321-b8258342a1cf-kube-api-access-c28sn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr\" (UID: \"52fcf85c-1338-4eed-8321-b8258342a1cf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:00.120996 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:00.120914    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:00.252640 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:00.252526    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"]
Jun 03 19:47:00.255599 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:47:00.255570    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fcf85c_1338_4eed_8321_b8258342a1cf.slice/crio-660dc8509e8c1529a29c78c3e28c56ee227b97bd7ed355c1bbf8881ab438775e WatchSource:0}: Error finding container 660dc8509e8c1529a29c78c3e28c56ee227b97bd7ed355c1bbf8881ab438775e: Status 404 returned error can't find the container with id 660dc8509e8c1529a29c78c3e28c56ee227b97bd7ed355c1bbf8881ab438775e
Jun 03 19:47:00.495341 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:00.495295    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:47:00.678465 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:00.678429    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr" event={"ID":"52fcf85c-1338-4eed-8321-b8258342a1cf","Type":"ContainerStarted","Data":"782275d19cda853653e27ace2aa32e237fe9fe14aae4259d8d568900a7abcd90"}
Jun 03 19:47:00.678619 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:00.678481    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr" event={"ID":"52fcf85c-1338-4eed-8321-b8258342a1cf","Type":"ContainerStarted","Data":"660dc8509e8c1529a29c78c3e28c56ee227b97bd7ed355c1bbf8881ab438775e"}
Jun 03 19:47:01.686232 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:01.686194    2549 generic.go:356] "Generic (PLEG): container finished" podID="52fcf85c-1338-4eed-8321-b8258342a1cf" containerID="782275d19cda853653e27ace2aa32e237fe9fe14aae4259d8d568900a7abcd90" exitCode=0
Jun 03 19:47:01.686621 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:01.686256    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr" event={"ID":"52fcf85c-1338-4eed-8321-b8258342a1cf","Type":"ContainerDied","Data":"782275d19cda853653e27ace2aa32e237fe9fe14aae4259d8d568900a7abcd90"}
Jun 03 19:47:02.692557 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:02.692513    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr" event={"ID":"52fcf85c-1338-4eed-8321-b8258342a1cf","Type":"ContainerStarted","Data":"6039d0b7f812cc5fad04fcfcbbdd55d06d10939b49b9cd7eebf91addd10b37ab"}
Jun 03 19:47:02.711348 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:02.711287    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr" podStartSLOduration=2.174377963 podStartE2EDuration="3.711271065s" totalImagesPullingTime="310.319585ms" totalInitContainerRuntime="1.226573517s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:02.708961929 +0000 UTC m=+976.328448166" watchObservedRunningTime="2026-06-03 19:47:02.711271065 +0000 UTC m=+976.330757319"
Jun 03 19:47:09.503155 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.503118    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"]
Jun 03 19:47:09.507658 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.507632    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.510190 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.510160    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 03 19:47:09.522350 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.519790    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"]
Jun 03 19:47:09.625320 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625280    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.625493 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625389    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b55cd09-29f9-480b-9d59-22d98ec06897-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.625493 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625431    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.625595 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625523    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.625595 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625542    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.625595 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.625566    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq7vk\" (UniqueName: \"kubernetes.io/projected/3b55cd09-29f9-480b-9d59-22d98ec06897-kube-api-access-jq7vk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.726740 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726702    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.726740 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726735    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726754    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq7vk\" (UniqueName: \"kubernetes.io/projected/3b55cd09-29f9-480b-9d59-22d98ec06897-kube-api-access-jq7vk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726817    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726879    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b55cd09-29f9-480b-9d59-22d98ec06897-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727008 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.726894    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727237 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.727129    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727237 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.727210    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.727343 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.727295    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.729184 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.729158    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b55cd09-29f9-480b-9d59-22d98ec06897-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.729488 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.729466    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b55cd09-29f9-480b-9d59-22d98ec06897-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.734214 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.734189    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq7vk\" (UniqueName: \"kubernetes.io/projected/3b55cd09-29f9-480b-9d59-22d98ec06897-kube-api-access-jq7vk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg\" (UID: \"3b55cd09-29f9-480b-9d59-22d98ec06897\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.819177 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.819092    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:09.947025 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:09.946997    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"]
Jun 03 19:47:09.948864 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:47:09.948841    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b55cd09_29f9_480b_9d59_22d98ec06897.slice/crio-216c94e0ede0294eda727d9f3717dbc36c06b386eae9c22ee782f909f72e99d3 WatchSource:0}: Error finding container 216c94e0ede0294eda727d9f3717dbc36c06b386eae9c22ee782f909f72e99d3: Status 404 returned error can't find the container with id 216c94e0ede0294eda727d9f3717dbc36c06b386eae9c22ee782f909f72e99d3
Jun 03 19:47:10.121638 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.121512    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:10.121638 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.121597    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:10.134137 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.134106    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:10.731555 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.731507    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg" event={"ID":"3b55cd09-29f9-480b-9d59-22d98ec06897","Type":"ContainerStarted","Data":"d14e8b5cf7bf25fbc6921c437b6cba7cb91cca4327b1d7586a26842a7f7dade2"}
Jun 03 19:47:10.731987 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.731574    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg" event={"ID":"3b55cd09-29f9-480b-9d59-22d98ec06897","Type":"ContainerStarted","Data":"216c94e0ede0294eda727d9f3717dbc36c06b386eae9c22ee782f909f72e99d3"}
Jun 03 19:47:10.743246 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:10.743220    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr"
Jun 03 19:47:11.299801 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:11.299748    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:47:11.736627 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:11.736589    2549 generic.go:356] "Generic (PLEG): container finished" podID="3b55cd09-29f9-480b-9d59-22d98ec06897" containerID="d14e8b5cf7bf25fbc6921c437b6cba7cb91cca4327b1d7586a26842a7f7dade2" exitCode=0
Jun 03 19:47:11.737029 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:11.736679    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg" event={"ID":"3b55cd09-29f9-480b-9d59-22d98ec06897","Type":"ContainerDied","Data":"d14e8b5cf7bf25fbc6921c437b6cba7cb91cca4327b1d7586a26842a7f7dade2"}
Jun 03 19:47:12.744328 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:12.744294    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg" event={"ID":"3b55cd09-29f9-480b-9d59-22d98ec06897","Type":"ContainerStarted","Data":"e7d50c8c53c9097497950691d116fab9d8868b1523f58469a74bd1739f7c9079"}
Jun 03 19:47:12.762288 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:12.762241    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg" podStartSLOduration=2.047570733 podStartE2EDuration="3.762224856s" totalImagesPullingTime="281.09228ms" totalInitContainerRuntime="1.433561843s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:12.759785432 +0000 UTC m=+986.379271661" watchObservedRunningTime="2026-06-03 19:47:12.762224856 +0000 UTC m=+986.381711090"
Jun 03 19:47:19.819398 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:19.819362    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:19.819816 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:19.819446    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:19.832058 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:19.832032    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:20.789779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:20.789724    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg"
Jun 03 19:47:22.305042 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.305010    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"]
Jun 03 19:47:22.309791 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.309752    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.311909 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.311886    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 03 19:47:22.318330 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.318306    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"]
Jun 03 19:47:22.439319 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439279    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.439502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439366    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82905bf3-4d1c-49ee-8e84-c3440dadbf25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.439502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439437    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.439502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439464    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.439502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439493    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.439648 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.439509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8xf8\" (UniqueName: \"kubernetes.io/projected/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kube-api-access-x8xf8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540290 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540251    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540290 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540295    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540313    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540330    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8xf8\" (UniqueName: \"kubernetes.io/projected/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kube-api-access-x8xf8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540383    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540544 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82905bf3-4d1c-49ee-8e84-c3440dadbf25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540796 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540721    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540861 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540795    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.540913 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.540896    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.542613 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.542593    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82905bf3-4d1c-49ee-8e84-c3440dadbf25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.542967 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.542951    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82905bf3-4d1c-49ee-8e84-c3440dadbf25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.547367 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.547346    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8xf8\" (UniqueName: \"kubernetes.io/projected/82905bf3-4d1c-49ee-8e84-c3440dadbf25-kube-api-access-x8xf8\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-87w5f\" (UID: \"82905bf3-4d1c-49ee-8e84-c3440dadbf25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.620701 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.620615    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:22.749839 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.749811    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"]
Jun 03 19:47:22.752403 ip-10-0-128-21 kubenswrapper[2549]: W0603 19:47:22.752377    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82905bf3_4d1c_49ee_8e84_c3440dadbf25.slice/crio-99a7b56274d254ccc49e18fe1d8d9cb69e6e1c9642f67a5087dc8fa863c6c5fe WatchSource:0}: Error finding container 99a7b56274d254ccc49e18fe1d8d9cb69e6e1c9642f67a5087dc8fa863c6c5fe: Status 404 returned error can't find the container with id 99a7b56274d254ccc49e18fe1d8d9cb69e6e1c9642f67a5087dc8fa863c6c5fe
Jun 03 19:47:22.789459 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:22.789431    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f" event={"ID":"82905bf3-4d1c-49ee-8e84-c3440dadbf25","Type":"ContainerStarted","Data":"99a7b56274d254ccc49e18fe1d8d9cb69e6e1c9642f67a5087dc8fa863c6c5fe"}
Jun 03 19:47:23.795592 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:23.795547    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f" event={"ID":"82905bf3-4d1c-49ee-8e84-c3440dadbf25","Type":"ContainerStarted","Data":"2b3d7c33d3a4f33585d0f55b3eed03ee7d42277ec52313cfbadf998e1752d56d"}
Jun 03 19:47:24.710713 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:24.710668    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:47:24.800783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:24.800725    2549 generic.go:356] "Generic (PLEG): container finished" podID="82905bf3-4d1c-49ee-8e84-c3440dadbf25" containerID="2b3d7c33d3a4f33585d0f55b3eed03ee7d42277ec52313cfbadf998e1752d56d" exitCode=0
Jun 03 19:47:24.801144 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:24.800816    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f" event={"ID":"82905bf3-4d1c-49ee-8e84-c3440dadbf25","Type":"ContainerDied","Data":"2b3d7c33d3a4f33585d0f55b3eed03ee7d42277ec52313cfbadf998e1752d56d"}
Jun 03 19:47:24.801326 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:24.801311    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:47:25.807155 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:25.807117    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f" event={"ID":"82905bf3-4d1c-49ee-8e84-c3440dadbf25","Type":"ContainerStarted","Data":"3fae91affcebe6c2fd357b081647d857e5e392ffbd0995d7dd22797401bc162d"}
Jun 03 19:47:25.825091 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:25.825037    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f" podStartSLOduration=2.247560251 podStartE2EDuration="3.825022976s" totalImagesPullingTime="311.88583ms" totalInitContainerRuntime="1.265576895s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:25.823156367 +0000 UTC m=+999.442642603" watchObservedRunningTime="2026-06-03 19:47:25.825022976 +0000 UTC m=+999.444509262"
Jun 03 19:47:32.620914 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:32.620874    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:32.621329 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:32.620946    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:32.633495 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:32.633470    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:47:32.848528 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:47:32.848496    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-87w5f"
Jun 03 19:49:05.299241 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:05.299204    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:49:14.592006 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:14.591971    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:49:24.593896 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:24.593855    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:49:34.895795 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:34.895737    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:49:44.200620 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:44.200581    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:49:53.295083 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:49:53.295050    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:50:46.888998 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:50:46.888967    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:50:46.889508 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:50:46.889461    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:51:06.401669 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:51:06.401633    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:51:20.592483 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:51:20.592444    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:51:59.397223 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:51:59.397172    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:52:16.194852 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:52:16.194813    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:52:30.619736 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:52:30.619698    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:52:45.399351 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:52:45.399318    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:53:39.594779 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:53:39.594731    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:53:49.010263 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:53:49.010222    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:54:06.094590 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:54:06.094557    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:54:15.895157 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:54:15.895116    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:54:31.696323 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:54:31.696239    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:54:40.696085 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:54:40.696051    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:12.104813 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:12.104772    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:20.893155 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:20.893116    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:29.402210 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:29.402173    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:37.692951 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:37.692903    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:45.697509 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:45.697470    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:55:46.923386 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:46.923356    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:55:46.925883 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:55:46.925863    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 19:56:02.297839 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:56:02.297741    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:56:13.505930 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:56:13.505896    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:00.395577 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:00.395541    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:06.698337 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:06.698295    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:13.498210 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:13.498174    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:21.802502 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:21.802461    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:32.296131 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:32.296048    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:41.502973 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:41.502938    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:49.999920 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:49.999884    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:57:56.996073 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:57:56.996037    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:07.691673 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:07.691628    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:14.503251 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:14.503221    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:25.305337 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:25.305296    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:32.108783 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:32.108735    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:43.295507 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:43.295467    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:49.897016 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:49.896975    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:58:58.401773 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:58:58.401672    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:59:08.697571 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:59:08.697532    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:59:18.099917 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:59:18.099879    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 19:59:23.997736 ip-10-0-128-21 kubenswrapper[2549]: I0603 19:59:23.997697    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:00:46.951295 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:00:46.951261    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:00:46.954261 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:00:46.954235    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:01:44.583965 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:01:44.583925    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:01:50.886457 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:01:50.886417    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:02:15.987464 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:02:15.987428    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:02:25.584755 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:02:25.584719    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:02:34.184846 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:02:34.184807    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:02:43.883966 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:02:43.883914    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:02:52.586289 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:02:52.586256    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:03.279986 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:03.279948    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:11.989278 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:11.989236    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:23.087099 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:23.087062    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:31.992340 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:31.992256    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:43.179347 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:43.179294    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:03:51.685004 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:03:51.684967    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:04:26.082809 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:04:26.082754    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:09.481065 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:09.480985    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:18.682932 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:18.682893    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:27.394230 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:27.394187    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:34.281360 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:34.281321    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:43.890823 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:43.890783    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:05:46.985037 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:46.985004    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:05:46.990327 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:46.990306    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:05:56.685660 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:05:56.685621    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:05.186505 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:05.186468    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:15.885323 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:15.885287    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:24.480124 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:24.480035    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:31.382223 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:31.382184    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:39.674290 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:39.674255    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:06:51.082133 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:06:51.082092    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:07:08.192312 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:07:08.192272    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:07:17.085733 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:07:17.085700    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:07:25.482012 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:07:25.481969    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:07:34.681966 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:07:34.681926    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:07:52.079231 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:07:52.079194    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:00.378190 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:00.378100    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:09.185727 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:09.185684    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:15.883693 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:15.883655    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:26.285460 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:26.285419    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:33.387579 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:33.387544    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:44.393697 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:44.393652    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:08:57.985541 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:08:57.985505    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:07.891431 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:07.891397    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:23.487211 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:23.487169    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:32.182873 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:32.182794    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:39.983267 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:39.983227    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:50.388180 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:50.388128    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:09:58.590020 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:09:58.589985    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:10:16.879634 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:16.879598    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:10:25.482270 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:25.482230    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:10:34.079894 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:34.079860    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:10:44.688575 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:44.688537    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:10:47.011449 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:47.011418    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:10:47.017629 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:10:47.017609    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:11:07.978319 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:07.978240    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:11:20.278283 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:20.278242    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7mzs9"]
Jun 03 20:11:30.641389 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:30.641360    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-2wkwb_c74b2752-1076-4369-9fa1-ff77de219062/copy-manifests/0.log"
Jun 03 20:11:30.647774 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:30.647743    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-2wkwb_c74b2752-1076-4369-9fa1-ff77de219062/manager/0.log"
Jun 03 20:11:32.529791 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:32.529746    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q2r98_75d547a1-3d07-41c3-8668-ce293f5b3698/kuadrant-console-plugin/0.log"
Jun 03 20:11:32.877092 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:32.877010    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7mzs9_5fc879e5-8ae7-4e40-b97a-4f5a015d596c/limitador/0.log"
Jun 03 20:11:33.644648 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:33.644619    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-p2f6f_f319f62d-5ccf-4664-bda7-4c3e7f415dcd/kube-auth-proxy/0.log"
Jun 03 20:11:34.300311 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.300276    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg_806384ce-1fdc-4661-93cf-8f8670ff0fd6/storage-initializer/0.log"
Jun 03 20:11:34.307507 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.307463    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vz7cg_806384ce-1fdc-4661-93cf-8f8670ff0fd6/main/0.log"
Jun 03 20:11:34.647897 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.647802    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr_52fcf85c-1338-4eed-8321-b8258342a1cf/storage-initializer/0.log"
Jun 03 20:11:34.654498 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.654473    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbgrmr_52fcf85c-1338-4eed-8321-b8258342a1cf/main/0.log"
Jun 03 20:11:34.762029 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.761992    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg_3b55cd09-29f9-480b-9d59-22d98ec06897/storage-initializer/0.log"
Jun 03 20:11:34.768515 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.768495    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2gcjg_3b55cd09-29f9-480b-9d59-22d98ec06897/main/0.log"
Jun 03 20:11:34.875897 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.875871    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-87w5f_82905bf3-4d1c-49ee-8e84-c3440dadbf25/storage-initializer/0.log"
Jun 03 20:11:34.881825 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:34.881801    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-87w5f_82905bf3-4d1c-49ee-8e84-c3440dadbf25/main/0.log"
Jun 03 20:11:42.022315 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:42.022283    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lzbk7_11cad0a4-1bad-4f59-a486-66fa414c782b/global-pull-secret-syncer/0.log"
Jun 03 20:11:42.088269 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:42.088237    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dx8m9_7c176592-725d-4ade-9fcd-e765d0eb40fe/konnectivity-agent/0.log"
Jun 03 20:11:42.141005 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:42.140978    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-21.ec2.internal_77e1a287528aa865925baabe12e40206/haproxy/0.log"
Jun 03 20:11:47.070234 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:47.070206    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-q2r98_75d547a1-3d07-41c3-8668-ce293f5b3698/kuadrant-console-plugin/0.log"
Jun 03 20:11:47.211487 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:47.211457    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7mzs9_5fc879e5-8ae7-4e40-b97a-4f5a015d596c/limitador/0.log"
Jun 03 20:11:49.146052 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.146021    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-g8mq5_af83bd92-5576-4505-b98c-7a11c3eba6ae/kube-state-metrics/0.log"
Jun 03 20:11:49.173713 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.173682    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-g8mq5_af83bd92-5576-4505-b98c-7a11c3eba6ae/kube-rbac-proxy-main/0.log"
Jun 03 20:11:49.196043 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.196018    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-g8mq5_af83bd92-5576-4505-b98c-7a11c3eba6ae/kube-rbac-proxy-self/0.log"
Jun 03 20:11:49.220196 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.220160    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b5589c6b8-cdkrx_3568cf18-2521-4618-ab47-c55d93caaa4e/metrics-server/0.log"
Jun 03 20:11:49.277647 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.277605    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqws_ab8e4b95-8743-4642-9eef-bfa38aba76bd/node-exporter/0.log"
Jun 03 20:11:49.298564 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.298538    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqws_ab8e4b95-8743-4642-9eef-bfa38aba76bd/kube-rbac-proxy/0.log"
Jun 03 20:11:49.319887 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.319823    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqws_ab8e4b95-8743-4642-9eef-bfa38aba76bd/init-textfile/0.log"
Jun 03 20:11:49.574660 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.574588    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/prometheus/0.log"
Jun 03 20:11:49.597408 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.597375    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/config-reloader/0.log"
Jun 03 20:11:49.618931 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.618901    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/thanos-sidecar/0.log"
Jun 03 20:11:49.642258 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.642229    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/kube-rbac-proxy-web/0.log"
Jun 03 20:11:49.663957 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.663923    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/kube-rbac-proxy/0.log"
Jun 03 20:11:49.685830 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.685800    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/kube-rbac-proxy-thanos/0.log"
Jun 03 20:11:49.707291 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.707265    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ae22c16-da4e-4bfe-af65-1725665a0939/init-config-reloader/0.log"
Jun 03 20:11:49.733916 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.733882    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hgqzq_2f35244b-304d-4ae6-abee-2bd7d3ea91f9/prometheus-operator/0.log"
Jun 03 20:11:49.754298 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:49.754271    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hgqzq_2f35244b-304d-4ae6-abee-2bd7d3ea91f9/kube-rbac-proxy/0.log"
Jun 03 20:11:52.966877 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:52.966843    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-4c8jc_9c32c03b-331b-47c8-b4e3-3c25f706ab47/download-server/0.log"
Jun 03 20:11:54.541948 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.541913    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"]
Jun 03 20:11:54.545408 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.545387    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.547834 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.547815    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"openshift-service-ca.crt\""
Jun 03 20:11:54.547927 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.547875    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jrmj9\"/\"kube-root-ca.crt\""
Jun 03 20:11:54.548673 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.548660    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jrmj9\"/\"default-dockercfg-8mhg6\""
Jun 03 20:11:54.555176 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.555154    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"]
Jun 03 20:11:54.731015 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.730970    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-proc\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.731200 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.731039    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-lib-modules\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.731200 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.731069    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm645\" (UniqueName: \"kubernetes.io/projected/836d1ac6-55d3-4b96-bb67-492732486ec1-kube-api-access-qm645\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.731200 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.731108    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-sys\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.731339 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.731224    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-podres\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832528 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832452    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-proc\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832528 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832496    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-lib-modules\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832528 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832516    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm645\" (UniqueName: \"kubernetes.io/projected/836d1ac6-55d3-4b96-bb67-492732486ec1-kube-api-access-qm645\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832550    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-sys\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832568    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-proc\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832587    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-podres\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832630    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-lib-modules\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832654    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-sys\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.832750 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.832716    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/836d1ac6-55d3-4b96-bb67-492732486ec1-podres\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.840249 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.840223    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm645\" (UniqueName: \"kubernetes.io/projected/836d1ac6-55d3-4b96-bb67-492732486ec1-kube-api-access-qm645\") pod \"perf-node-gather-daemonset-lt7nr\" (UID: \"836d1ac6-55d3-4b96-bb67-492732486ec1\") " pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.856104 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.856080    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:54.860071 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.860050    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-55gbb_70377450-eb03-41eb-baf9-fe3cc22d8df8/dns/0.log"
Jun 03 20:11:54.879566 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.879547    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-55gbb_70377450-eb03-41eb-baf9-fe3cc22d8df8/kube-rbac-proxy/0.log"
Jun 03 20:11:54.989461 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:54.989426    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"]
Jun 03 20:11:54.993391 ip-10-0-128-21 kubenswrapper[2549]: W0603 20:11:54.993368    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod836d1ac6_55d3_4b96_bb67_492732486ec1.slice/crio-00b179e0ffadc5ffb01ee220b0885d906c30e69a2c44ac6e17946ab02fbca4ad WatchSource:0}: Error finding container 00b179e0ffadc5ffb01ee220b0885d906c30e69a2c44ac6e17946ab02fbca4ad: Status 404 returned error can't find the container with id 00b179e0ffadc5ffb01ee220b0885d906c30e69a2c44ac6e17946ab02fbca4ad
Jun 03 20:11:55.022445 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.022419    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hc2sd_2c7fed49-86de-423a-b51c-f30d6576e27e/dns-node-resolver/0.log"
Jun 03 20:11:55.253085 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.253053    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr" event={"ID":"836d1ac6-55d3-4b96-bb67-492732486ec1","Type":"ContainerStarted","Data":"6994a589959803e231fb4bddc32bd453ccb135d576691234d0d99f355127d3b0"}
Jun 03 20:11:55.253257 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.253104    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr" event={"ID":"836d1ac6-55d3-4b96-bb67-492732486ec1","Type":"ContainerStarted","Data":"00b179e0ffadc5ffb01ee220b0885d906c30e69a2c44ac6e17946ab02fbca4ad"}
Jun 03 20:11:55.253257 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.253153    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:11:55.268178 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.268131    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr" podStartSLOduration=1.268117514 podStartE2EDuration="1.268117514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:11:55.267413231 +0000 UTC m=+2468.886899466" watchObservedRunningTime="2026-06-03 20:11:55.268117514 +0000 UTC m=+2468.887603748"
Jun 03 20:11:55.590614 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:55.590527    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8dnw_9928cd71-078a-4579-87af-e1868957cf2f/node-ca/0.log"
Jun 03 20:11:56.677791 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:56.677745    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-p2f6f_f319f62d-5ccf-4664-bda7-4c3e7f415dcd/kube-auth-proxy/0.log"
Jun 03 20:11:57.468585 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:57.468557    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhn2c_d27be6a6-e7d6-4f39-833c-c2a3bb1de913/serve-healthcheck-canary/0.log"
Jun 03 20:11:58.134481 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:58.134449    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gskhp_8ebc8171-e1c7-433a-943d-caddca0b9632/kube-rbac-proxy/0.log"
Jun 03 20:11:58.157407 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:58.157359    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gskhp_8ebc8171-e1c7-433a-943d-caddca0b9632/exporter/0.log"
Jun 03 20:11:58.178275 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:11:58.178245    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gskhp_8ebc8171-e1c7-433a-943d-caddca0b9632/extractor/0.log"
Jun 03 20:12:00.889025 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:00.888993    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-2wkwb_c74b2752-1076-4369-9fa1-ff77de219062/manager/0.log"
Jun 03 20:12:00.906951 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:00.906923    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548746c444-2wkwb_c74b2752-1076-4369-9fa1-ff77de219062/copy-manifests/0.log"
Jun 03 20:12:01.267260 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:01.267235    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jrmj9/perf-node-gather-daemonset-lt7nr"
Jun 03 20:12:02.616663 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:02.616630    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cc8ff6b7b-rm9n2_877f722c-3a84-4deb-b3c1-cc3c5c04901f/manager/0.log"
Jun 03 20:12:07.324393 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:07.324364    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-p2f6f_f319f62d-5ccf-4664-bda7-4c3e7f415dcd/kube-auth-proxy/0.log"
Jun 03 20:12:08.730129 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:08.730097    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-p2f6f_f319f62d-5ccf-4664-bda7-4c3e7f415dcd/kube-auth-proxy/0.log"
Jun 03 20:12:09.835711 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.835682    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/kube-multus-additional-cni-plugins/0.log"
Jun 03 20:12:09.855869 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.855842    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/egress-router-binary-copy/0.log"
Jun 03 20:12:09.875669 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.875631    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/cni-plugins/0.log"
Jun 03 20:12:09.894161 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.894135    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/bond-cni-plugin/0.log"
Jun 03 20:12:09.912055 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.912028    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/routeoverride-cni/0.log"
Jun 03 20:12:09.930202 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.930181    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/whereabouts-cni-bincopy/0.log"
Jun 03 20:12:09.948801 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:09.948775    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d96mp_da6adb52-fab5-4808-a01d-18082a3b1b98/whereabouts-cni/0.log"
Jun 03 20:12:10.265515 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:10.265467    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fgtfn_3edf1a0b-a2c6-4ec1-93c5-79584b1ec978/kube-multus/0.log"
Jun 03 20:12:10.349391 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:10.349365    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nc4kc_0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3/network-metrics-daemon/0.log"
Jun 03 20:12:10.366361 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:10.366337    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nc4kc_0a545cfe-8b0a-4b04-8e9d-c0c3a920d4a3/kube-rbac-proxy/0.log"
Jun 03 20:12:10.543569 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:10.543487    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89c854d9f-p2f6f_f319f62d-5ccf-4664-bda7-4c3e7f415dcd/kube-auth-proxy/0.log"
Jun 03 20:12:11.775870 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.775836    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-controller/0.log"
Jun 03 20:12:11.794708 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.794679    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/1.log"
Jun 03 20:12:11.794883 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.794752    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovn-acl-logging/0.log"
Jun 03 20:12:11.813148 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.813126    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/kube-rbac-proxy-node/0.log"
Jun 03 20:12:11.835322 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.835297    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 20:12:11.851088 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.851064    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/northd/0.log"
Jun 03 20:12:11.870208 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.870181    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/nbdb/0.log"
Jun 03 20:12:11.889741 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.889710    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/sbdb/0.log"
Jun 03 20:12:11.928486 ip-10-0-128-21 kubenswrapper[2549]: I0603 20:12:11.928461    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9gnk_979acffb-cc1d-40ea-b3c0-d5af6edc4706/ovnkube-controller/0.log"